Datamesh GmbH, an innovative software development company, is seeking a dedicated Data Engineer to strengthen our dynamic team. Based in Germany, with a small but highly specialized team of 1-10 employees, Datamesh GmbH offers the opportunity to work in an agile and creative environment. Our passion for technology and developing new software solutions drives us to push the boundaries of what's possible. As a Data Engineer, you will play a central role in developing and implementing complex data architectures that support our software solutions.

Tasks

• Developing data pipelines based on Databricks on Azure
• Development of Prefect / Dagster / Airflow pipelines
• Development of Big Data pipelines based on Databricks
• Development of real-time applications based on Apache Kafka
• Building a data lake including data processing based on dbt tools
• Support in the concept and design processes
• Assistance with processing customer and support requests
• Infrastructure automation via Terraform (with Python)
• Support for senior developers

qualification

• You have a completed degree in computer science or a comparable field of study.
• You have good IT skills with Git and Outlook.
• Linux / UNIX
• Good knowledge of English and German, both spoken and written.
• You have an independent work style, are reliable and communicative.
• At least 1 year of Databricks experience
• At least 1 year of Azure experience
• At least 1 year of CI/CD experience
• At least 1 year of data engineering experience
• You have expertise in one of the following programming languages/frameworks:

1. Java / Scala
2. python
3. Spring Boot / Apache Spark / Apache Airflow
4. Bash / Ansible / ssh / RSA Keys / Networking
5. Azure Cloud
6. DBT / Databricks