Senior Data Engineer

at  EPAM Systems Inc

Australia, , Australia -

Start DateExpiry DateSalaryPosted OnExperienceSkillsTelecommuteSponsor Visa
Immediate23 Apr, 2025Not Specified23 Jan, 2025N/APython,Distributed Systems,Git,Json,Apache Spark,Version Control Tools,Sql,Data Processing,PipelineNoNo
Add to Wishlist Apply All Jobs
Required Visa Status:
CitizenGC
US CitizenStudent Visa
H1BCPT
OPTH4 Spouse of H1B
GC Green Card
Employment Type:
Full TimePart Time
PermanentIndependent - 1099
Contract – W2C2H Independent
C2H W2Contract – Corp 2 Corp
Contract to Hire – Corp 2 Corp

Description:

We are looking for an experienced Senior Data Engineer to join our team and play a critical role in designing and optimizing scalable data solutions.
The ideal candidate has extensive experience with cloud platforms, data processing frameworks, and ETL/ELT pipelines and is passionate about solving complex data challenges.

REQUIREMENTS

  • Strong expertise in cloud platforms, specifically Azure (e.g., Synapse, Data Factory, Databricks, Data Lake)
  • Proficiency in Python, SQL, and Apache Spark for data processing and pipeline development
  • Experience with scalable data architectures, including file formats such as Parquet, Delta, and JSON
  • Solid understanding of modern data processing frameworks and distributed systems
  • Practical experience with CI/CD practices and version control tools like Git
  • Excellent problem-solving skills and the ability to communicate technical concepts effectively

WE OFFER

  • By choosing EPAM, you’re getting a job at Great Place To Work-Certified™ in 2024, Glassdoor’s Top 100 Best Places to Work in 2023 & one of Most Loved Workplace, as recognized by Newsweek, 2021 - 2023.
  • Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters.
  • You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices.
  • We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey.
  • At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us.

Responsibilities:

  • Design, develop, and optimize ETL/ELT pipelines for seamless data integration and transformation
  • Build and maintain scalable data architectures to support analytics and business intelligence
  • Work with large-scale data processing frameworks to ensure efficient and secure data handling
  • Manage and process structured and unstructured data using various file formats
  • Develop robust pipelines and workflows for high-performance data solutions
  • Implement and maintain CI/CD pipelines to support efficient development and deployment
  • Collaborate with stakeholders to align technical solutions with business goals and requirements
  • Create datasets, reports, and dashboards to deliver actionable insights


REQUIREMENT SUMMARY

Min:N/AMax:5.0 year(s)

Information Technology/IT

IT Software - Other

Software Engineering

Graduate

Proficient

1

Australia, Australia