AWS Data Engineer

at  Capgemini

THE JOB YOU’RE CONSIDERING

The Cloud Data Platforms team is part of the Insights and Data Global Practice and has seen strong growth and continued success across a variety of projects and sectors. Cloud Data Platforms is the home of the Data Engineers, Platform Engineers, Solutions Architects and Business Analysts who are focused on driving our customers digital and data transformation journey using the modern cloud platforms. We specialise on using the latest frameworks, reference architectures and technologies using AWS, Azure and GCP.

YOUR SKILLS AND EXPERIENCE

• Experience of AWS tools (e.g Athena, Redshift, Glue, EMR) Java, Scala, Python, Spark
• Experience of developing enterprise grade ETL/ELT data pipelines and demonstratable knowledge of applying Data Engineering best practices (coding practices to DS, unit testing, version control, code review).
• Big Data Eco-Systems, Cloudera/Hortonworks, AWS EMR, GCP DataProc or GCP Cloud Data Fusion.
• Streaming technologies and processing engines, Kinesis, Kafka, Pub/Sub and Spark Streaming.
• Experience of working with CI/CD technologies, Git, Jenkins, Spinnaker, GCP Cloud Build, Ansible etc and experience building and deploying solutions to Cloud (AWS, Google Cloud) including Cloud provisioning tools

We are looking for strong AWS Data Engineers who are passionate about Cloud technology. Your work will be to:

• Design and build data engineering solutions and support the planning and implementation of data platform services including sizing, configuration, and needs assessment
• Work with clients, local teams and offshore resources to deliver modern data products and build relationships.
• Use AWS Data focused Reference Architecture, Design and build data service APIs
• Analyse current business practices, processes and procedures and identify future opportunities for leveraging AWS services and implement effective metrics and monitoring processes.