ETL Engineer (GCP Focus)

at  Virtusa

JOB DESCRIPTION:

• We are seeking an experienced Senior ETL Engineer to join our team, where you will be responsible for designing, developing, and maintaining scalable data pipelines in Google Cloud Platform (GCP), with additional knowledge of Azure and DataStage tools. This role will enable you to work with cutting-edge cloud technologies to transform complex data sets into actionable insights that drive key business decisions.

PREFERRED SKILLS AND EXPERIENCE:

• 5+ years of hands-on ETL development experience.
• Strong experience with ETL development in Google Cloud Platform (GCP).
• Expertise in writing complex SQL queries and troubleshooting data pipelines.
• Knowledge of Azure and ability to integrate solutions across multi-cloud environments.
• Experience with DataStage 11.7 (or similar tools) for legacy or hybrid cloud implementations.
• Strong problem-solving and troubleshooting skills, with the ability to identify and address bottlenecks in data processing.
• Experience with data mapping and designing scalable, distributed systems.
• Ability to create clear documentation for all new and modified ETL processes.
  Job Type: Fixed term contract
  Contract length: 12 months
  Pay: Up to $60.00 per hour

Experience:

• GCP: 2 years (required)
• ETL Engineer: 6 years (required)

KEY RESPONSIBILITIES:

• Design, develop, and maintain ETL processes using GCP technologies such as BigQuery, Cloud Dataflow, Pub/Sub, and Cloud Storage.
• Work with cross-functional teams to gather and analyze data requirements, ensuring efficient data integration across cloud platforms (GCP and Azure).
• Design and develop complex ETL batch jobs and data workflows, optimizing for scalability, performance, and reliability.
• Write and troubleshoot complex SQL queries to extract, transform, and load data efficiently.
• Ensure data quality and integrity through automated validation and monitoring processes.
• Collaborate with team members to improve existing ETL processes and identify performance bottlenecks.
• Document all new developments and modifications to ETL processes, ensuring clear and comprehensive records.
• (Nice to have) Experience with DataStage 11.7 for building scalable data solutions and data conversion processes.