EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team.
The ideal candidate will be deeply involved in handling big data migrations, orchestrating DevOps pipelines, and driving technical solutions while closely collaborating with stakeholders across various teams. As a lead, you will also be responsible for overseeing a team of data engineers, promoting best practices in data management and ensuring our data architecture supports our business goals.

REQUIREMENTS

• Minimum of 5 years’ experience in data engineering or similar roles
• Proficiency in Python and PySpark
• Expertise in MLOps methodologies
• Showcase of projects managed on Github
• Skills in Databricks and Azure cloud services
• Background in setting up CI/CD pipelines using GitHub Actions and Terraform
• Capacity to lead and mentor a team of engineers

• Analyze datasets to identify discrepancies and areas for improvement
• Execute data migration from CF1 to CF2 using Azure
• Establish and maintain a GitHub repository for efficient code management
• Implement Azure resources integrated with ADP
• Develop and manage CI/CD pipelines leveraging Github actions and Terraform
• Deploy code to new environments ensuring compliance and performance
• Monitor and run the code to deliver optimal results
• Conduct technical validation of the output
• Communicate regularly with stakeholders, providing updates on project status and outcomes