Tasks

• Developing data pipelines based on Databricks on Azure
• Development of Prefect / Dagster / Airflow pipelines
• Development of Big Data pipelines based on Databricks
• Development of real-time applications based on Apache Kafka
• Building a data lake including data processing based on dbt tools
• Support in the concept and design processes
• Assistance with processing customer and support requests
• Infrastructure automation via Terraform (with Python)
• Support for senior developers

qualification

• You have a completed degree in computer science or a comparable field of study.
• You have good IT skills with Git and Outlook.
• Linux / UNIX
• Good knowledge of English and German, both spoken and written.
• You have an independent work style, are reliable and communicative.
• At least 1 year of Databricks experience
• At least 1 year of Azure experience
• At least 1 year of CI/CD experience
• At least 1 year of data engineering experience
• You have expertise in one of the following programming languages/frameworks:

1. Java / Scala
2. python
3. Spring Boot / Apache Spark / Apache Airflow
4. Bash / Ansible / ssh / RSA Keys / Networking
5. Azure Cloud
6. DBT / Databricks