Y-Axis Jobs Logo
Send us feedback
telephone  +91 7670 800 001
Log in Sign up Try Premium
AWS Data Engineer at Toronto, ON at Atlantis IT group
Toronto, ON M5A 3N7, Canada -
Full Time

Start Date

Immediate

Expiry Date

14 Sep, 25

Salary

0.0

Posted On

16 Jun, 25

Experience

0 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

No

Skills

Good communication skills

Industry

Information Technology/IT

Description
Responsibilities
  • Pyspark, Python, SQL coding is important.
  • Design, build, and maintain robust ETL/ELT pipelines using AWS Glue and Apache Airflow.
  • Expertise in Apache Airflow DAG creation, scheduling, dependency management, and error handling.
  • Strong hands-on experience with AWS Glue both Glue Jobs (PySpark) and Glue Catalog.
  • Develop SQL scripts and optimize data models in Amazon Redshift.
  • Orchestrate data workflows and job dependencies using Airflow DAGs.
  • Collaborate with data engineers, analysts, and stakeholders to understand data requirements and deliver scalable solutions.
  • Implement and enforce data quality checks, schema validation, and monitoring for all data pipelines.
  • Integrate various AWS services including S3, Lambda, Step Functions, Athena, and CloudWatch.