Senior Data Engineer
at EPAM Systems Inc
Australia, , Australia -
Start Date | Expiry Date | Salary | Posted On | Experience | Skills | Telecommute | Sponsor Visa |
---|---|---|---|---|---|---|---|
Immediate | 23 Apr, 2025 | Not Specified | 23 Jan, 2025 | N/A | Python,Distributed Systems,Git,Json,Apache Spark,Version Control Tools,Sql,Data Processing,Pipeline | No | No |
Required Visa Status:
Citizen | GC |
US Citizen | Student Visa |
H1B | CPT |
OPT | H4 Spouse of H1B |
GC Green Card |
Employment Type:
Full Time | Part Time |
Permanent | Independent - 1099 |
Contract – W2 | C2H Independent |
C2H W2 | Contract – Corp 2 Corp |
Contract to Hire – Corp 2 Corp |
Description:
We are looking for an experienced Senior Data Engineer to join our team and play a critical role in designing and optimizing scalable data solutions.
The ideal candidate has extensive experience with cloud platforms, data processing frameworks, and ETL/ELT pipelines and is passionate about solving complex data challenges.
REQUIREMENTS
- Strong expertise in cloud platforms, specifically Azure (e.g., Synapse, Data Factory, Databricks, Data Lake)
- Proficiency in Python, SQL, and Apache Spark for data processing and pipeline development
- Experience with scalable data architectures, including file formats such as Parquet, Delta, and JSON
- Solid understanding of modern data processing frameworks and distributed systems
- Practical experience with CI/CD practices and version control tools like Git
- Excellent problem-solving skills and the ability to communicate technical concepts effectively
WE OFFER
- By choosing EPAM, you’re getting a job at Great Place To Work-Certified™ in 2024, Glassdoor’s Top 100 Best Places to Work in 2023 & one of Most Loved Workplace, as recognized by Newsweek, 2021 - 2023.
- Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters.
- You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices.
- We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey.
- At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us.
Responsibilities:
- Design, develop, and optimize ETL/ELT pipelines for seamless data integration and transformation
- Build and maintain scalable data architectures to support analytics and business intelligence
- Work with large-scale data processing frameworks to ensure efficient and secure data handling
- Manage and process structured and unstructured data using various file formats
- Develop robust pipelines and workflows for high-performance data solutions
- Implement and maintain CI/CD pipelines to support efficient development and deployment
- Collaborate with stakeholders to align technical solutions with business goals and requirements
- Create datasets, reports, and dashboards to deliver actionable insights
REQUIREMENT SUMMARY
Min:N/AMax:5.0 year(s)
Information Technology/IT
IT Software - Other
Software Engineering
Graduate
Proficient
1
Australia, Australia