About the job

Key Responsibilities

• Design, develop and maintain scalable ETL/ELT data pipelines.
• Build and support data solutions using AWS S3, Glue, EMR, Athena and Aurora PostgreSQL.
• Develop data processing and transformation solutions using Python, SQL, Spark and PySpark.
• Design and maintain effective data models for analytical and operational requirements.
• Implement and support Change Data Capture (CDC) and data integration processes.
• Ensure data quality, governance, security and reliability across data platforms.
• Troubleshoot production issues and optimise data pipelines for performance and scalability.
• Implement automated deployments and testing through CI/CD pipelines and GitHub Actions.
• Collaborate with engineering, architecture, product and business stakeholders in an Agile environment.

Key Skills

• Strong hands-on experience with SQL and Python.
• Strong AWS experience, particularly S3, Glue, EMR, Athena and Aurora PostgreSQL.
• Strong experience with Spark/PySpark.
• Experience developing ETL/ELT pipelines and data integration solutions.
• Strong understanding of data modelling and operational databases.
• Experience with CDC, data governance, monitoring and CI/CD.