Senior Data Integration Engineer at EPAM Systems Inc
Australia, , Australia -
Full Time


Start Date

Immediate

Expiry Date

23 Apr, 25

Salary

0.0

Posted On

23 Jan, 25

Experience

0 year(s) or above

Remote Job

No

Telecommute

No

Sponsor Visa

No

Skills

Star Schema, Python, Processing, Git, Scripting, Data Transformation, Dimensional Modeling, Automation, Apache Spark, Version Control Tools, Optimization, Transformations, Cloud Services, Storage, Sql

Industry

Information Technology/IT

Description

We are seeking an experienced Senior Data Integration Engineer to design and implement scalable, efficient data integration solutions.
This role focuses on enabling seamless data flow and connectivity between systems, ensuring reliable and consistent data for business operations and analytics.

REQUIREMENTS

  • Expertise in Azure cloud services, including data pipelines, processing, and storage (e.g., Azure Synapse, Data Factory, Data Lake)
  • Strong proficiency in SQL for querying, data transformation, and optimization
  • Experience with Python for automation, scripting, and developing data workflows and transformations
  • Familiarity with distributed data processing frameworks like Apache Spark
  • In-depth understanding of data modeling principles (e.g., dimensional modeling, star schema)
  • Hands-on experience with CI/CD pipelines and version control tools like Git
  • Proven ability to troubleshoot and optimize complex data workflows

WE OFFER

  • By choosing EPAM, you’re getting a job at Great Place To Work-Certified™ in 2024, Glassdoor’s Top 100 Best Places to Work in 2023 & one of Most Loved Workplace, as recognized by Newsweek, 2021 - 2023.
  • Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters.
  • You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices.
  • We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey.
  • At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us.
Responsibilities
  • Design and implement data integration pipelines to connect operational systems with analytics environments
  • Develop and optimize ETL/ELT workflows using modern cloud platforms, ensuring efficient data transformation and movement
  • Leverage Azure tools to manage data pipelines, processing, and storage effectively
  • Manage and optimize data storage solutions using best practices in structured and unstructured data handling
  • Apply data modeling techniques to design robust and scalable data architectures
  • Write and optimize complex SQL queries for data transformations and reporting
  • Develop data workflows and processes using Python and distributed frameworks to handle large-scale data
  • Monitor and maintain data workflows to ensure reliability, performance, and operational efficiency
  • Collaborate with stakeholders to understand business and technical requirements and deliver aligned solutions
Loading...