JOB DESCRIPTION:

• 7+ years of experience in Amazon Web Services (AWS) Cloud Computing
• Strong background in designing, developing, and maintaining scalable data pipelines for ingestion and processing using Python, Spark, and AWS services

KEY SKILLS & EXPERTISE

• ETL Development: Implement and manage ETL processes using AWS Glue and EMR for both batch and streaming data
• Data Storage Solutions: Design and maintain storage solutions using Medallion Architecture in S3 and Redshift
• Workflow Orchestration: Monitor and optimize data workflows using Airflow or other orchestration tools
• Data Quality: Ensure accuracy, consistency, and integrity throughout the data lifecycle
• CI/CD: Implement and understand CI/CD practices for automated data pipeline deployment
• System Monitoring: Utilize CloudWatch and Datadog for performance monitoring and reliability
• Collaboration: Work closely with cross-functional teams to gather requirements and deliver business-driven data solutions
• Communication: Strong ability to communicate project updates and technical details to stakeholders.

Please refer the Job description for details