Data Engineer at Qode

, Pennsylvania, United States -

Full Time

Start Date

Immediate

Expiry Date

25 May, 26

Salary

0.0

Posted On

24 Feb, 26

Experience

2 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Aws, S3, Glue, Redshift, Lambda, Emr, Athena, Rds, Python, Sql, Etl/elt, Data Warehousing, Data Lake, Apache Spark, PySpark, Airflow

Industry

Software Development

Description

Job Summary:We are looking for a skilled Data Engineer with strong hands-on experience in AWS to design, build, and maintain scalable data pipelines and cloud-based data platforms. The ideal candidate will have expertise in modern data warehousing, ETL/ELT development, and distributed data processing while ensuring data quality, performance, and security. Key Responsibilities:· Design, develop, and maintain scalable data pipelines using AWS services.· Build and optimize ETL/ELT workflows for structured and unstructured data.· Implement data lakes and data warehouses on AWS.· Work with large datasets to ensure high performance, reliability, and data integrity.· Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements.· Perform data modeling for analytical and operational use cases.· Ensure data quality, governance, and security best practices.· Monitor and troubleshoot data workflows and production issues.· Support CI/CD and automation for data platform deployments. Required Skills & Experience:· Strong hands-on experience with AWS services such as S3, Glue, Redshift, Lambda, EMR, Athena, and RDS.· Proficiency in Python and SQL for data processing and analysis.· Experience in building and optimizing ETL/ELT pipelines.· Solid understanding of data warehousing and data lake architecture.· Experience with Apache Spark / PySpark.· Knowledge of workflow orchestration tools (Airflow or similar).· Familiarity with streaming frameworks (Kinesis/Kafka) is a plus.· Experience with data modeling and performance tuning.· Understanding of DevOps, CI/CD, and infrastructure as code (Terraform/CloudFormation).· Experience working in Agile/Scrum environments. Good to Have:· Experience with Snowflake on AWS.· Exposure to real-time data processing.· AWS certification (e.g., AWS Certified Data Analytics / Solutions Architect). Soft Skills:· Strong problem-solving and analytical skills.· Excellent communication and stakeholder management.· Ability to work in a fast-paced, collaborative environment.

Responsibilities

The role involves designing, building, and maintaining scalable data pipelines and cloud-based data platforms primarily using AWS services. Key tasks include building and optimizing ETL/ELT workflows, implementing data lakes and warehouses, and ensuring data quality and security.