We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 4 years of experience managing data engineering jobs in Big Data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing and maintaining data ingestion and processing jobs.

REQUIREMENTS

• Proven experience completing projects using Waterfall or Agile methodologies
• Expert-level skills in SQL, data modeling and data analysis
• Hands-on experience with big data engineering using Python, PySpark, Linux, and ETL tools like Informatica
• Proficiency in a reporting or visualization tool such as SAP BusinessObjects or Tableau
• Familiarity with DevOps deployment and data virtualization tools like Denodo is a plus
• Track record of implementing systems using Hive, Impala, and Cloudera Data Platform
• Strong understanding of analytics and data warehouse architectures
• Ability to troubleshoot complex issues, from system resources to application stack traces
• Experience with high-availability, high-performance, and secure system implementations in on-premise or cloud environments is an advantage
• A passion for automation, standardization and best practices
• No visa sponsorship

WE OFFER

• By choosing EPAM, you’re getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.
• Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
• You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
• We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
• At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us

• Analyze and document client data requirements to inform and guide project initiatives
• Streamline data pipelines and refine data collection by migrating to more efficient channels
• Design and implement data engineering solutions, from ETL jobs to analytical reporting
• Develop comprehensive test plans and scripts and support user acceptance testing (UAT)
• Build custom reports and dashboards that align with user needs
• Collaborate with client technical teams to ensure seamless solution deployment and adoption
• Maintain the operational health and service levels of IT solutions
• Troubleshoot and resolve production issues in a timely manner