EY - GDS Consulting - AI and DATA - Hadoop - Senior at EY

Hyderabad, Telangana, India -

Full Time

Start Date

Immediate

Expiry Date

21 Dec, 25

Salary

0.0

Posted On

22 Sep, 25

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Data Engineering, Apache Spark, Hive, Hadoop, ETL, Data Ingestion, UNIX, Shell Scripting, Data Governance, Data Quality, Containerization, DevOps, CI/CD, Communication, Teamwork, Problem Solving

Industry

Professional Services

Description

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. EY-Advisory - Data and Analytics – Senior Technology Consultant. EY's Advisory Services is a unique, industry-focused business unit that provides a broad range of integrated services that leverage deep industry experience with strong functional and technical capabilities and product knowledge. EY’s financial services practice provides integrated advisory services to financial institutions and other capital markets participants, including commercial banks, retail banks, investment banks, broker-dealers & asset management firms, and insurance firms from leading Fortune 500 Companies. Within EY’s Advisory Practice, Data and Analytics team solves big, complex issues and capitalize on opportunities to deliver better working outcomes that help expand and safeguard the businesses, now and in the future. This way we help create a compelling business case for embedding the right analytical practice at the heart of client’s decision-making. The opportunity We are looking for a Senior Data Engineer for Senior technology Consultant role with 6+ years of hands-on experience in developing and maintaining large-scale data processing systems. Candidate will have deep, practical expertise in the big data ecosystem, specifically in Spark, Hive, Hadoop, and Apache Iceberg. Candidate should be a key contributor on the team, responsible for building efficient, reliable, and scalable data pipelines that feed our data Lakehouse and power analytics. Your key responsibilities Experience of 6+ years in data engineering with a proven track record of building and maintaining large-scale data processing systems. Hands-on programming experience in Apache Spark using Spark SQL, Pyspark SQL and HQL. Hands on experience with major components like Hive, PIG, Spark, MapReduce. Hands on writing HiveQL queries and Spark jobs to ensure high performance and cost-effectiveness. Tune jobs for efficient resource utilization in a distributed cluster environment. Hands on Building and maintaining ETL/ELT processes to ingest data from a variety of sources (databases, APIs, logs, streams) into our central data platform. Strong understanding & familiarity with all Hadoop Ecosystem Experienced in Hadoop clustering and Auto scaling. Knowledge of Apache Oozie based workflow. Solid understanding of ETL methodologies in a multi-tiered stack, integrating with Big Data systems like Hadoop and Cassandra. Define and develop client specific business rules around data within a Hadoop environment on Azure cloud Design and develop data ingestion programs to process large data sets in Batch mode using HIVE, Pig and Sqoop technologies. Experience on clean, maintainable, and well-documented code with best practices, including version control (Git), code reviews, unit testing, and CI/CD. Strong UNIX operating system concepts and shell scripting knowledge. Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution. Knowledge on Anti Money Laundering- Transaction Monitoring will be an added advantage Experience in converting business problems/challenges to technical solutions considering security, performance, scalability etc. Excellent communicator (written and verbal formal and informal). Ability to multi-task under pressure and work independently with minimal supervision. Strong verbal and written communication skills. Must be a team player and enjoy working in a cooperative and collaborative team environment. Adaptable to new technologies and standards. Minimum 6 years hand-on experience in one or more of the above areas. Skills and attributes for success Use an issue-based approach to deliver growth, market and portfolio strategy engagements for corporates Strong communication, presentation and team building skills and experience in producing high quality reports, papers, and presentations. Experience in executing and managing research and analysis of companies and markets, preferably from a commercial due diligence standpoint. Ideally, you’ll also have Experience with stream processing technologies such as Kafka or Kinesis. Knowledge of data governance and data quality frameworks. Experience with containerization (Docker, Kubernetes). Familiarity with DevOps/DataOps practices and CI/CD pipelines. What we look for A Team of people with commercial acumen, technical experience and enthusiasm to learn new things in this fast-moving environment An opportunity to be a part of market-leading, multi-disciplinary team of 1400 + professionals, in the only integrated global transaction business worldwide. Opportunities to work with EY Advisory practices globally with leading businesses across a range of industries What working at EY offers At EY, we’re dedicated to helping our clients, from startups to Fortune 500 companies — and the work we do with them is as varied as they are. You get to work with inspiring and meaningful projects. Our focus is education and coaching alongside practical experience to ensure your personal development. We value our employees, and you will be able to control your own development with an individual progression plan. You will quickly grow into a responsible role with challenging and stimulating assignments. Moreover, you will be part of an interdisciplinary environment that emphasizes high quality and knowledge exchange. Plus, we offer: Support, coaching and feedback from some of the most engaging colleagues around Opportunities to develop new skills and progress your career The freedom and flexibility to handle your role in a way that’s right for you EY | Building a better working world EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets. Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate. Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.

How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities

The Senior Data Engineer will be responsible for building efficient, reliable, and scalable data pipelines that feed the data Lakehouse and power analytics. This role requires hands-on experience in developing and maintaining large-scale data processing systems.