Medior Data Engineer

at  DPG Media

Antwerp/Amsterdam/Rotterdam - As a Data Engineer you exploit the daily reach of millions of readers and viewers on our online platforms as a competitive advantage by closely collaborating with analysts and data scientists across all departments throughout the entire organisation. You build cloud-based data pipelines, both batch and streaming, and its underlying infrastructure.
As a Data Engineer you ensure the reliability and stability of our Group Data Platform and its data pipelines: you implement required monitoring, you understand how to balance the costs of running cloud processes with benefits of reliable speed of delivery and you want to continually improve production systems. In short: you live up to our principle ‘You Built It, You Run It’.

FURTHERMORE, YOU HAVE EXPERIENCE IN:

• working with AWS
• developing applications in a Kubernetes environment
• developing batch jobs in Apache Spark (pyspark or Scala) and scheduling them in an Airflow environment
• developing streaming applications for Apache Kafka in Python or Scala
• working with CI/CD pipelines
• writing Infrastructure as Code with Terraform
• transferring knowledge to other team members.

Please refer the Job description for details