Senior Data Engineer (m/f/d) at SpotmyEnergy GmbH

Berlin, Berlin, Germany -

Full Time

Start Date

Immediate

Expiry Date

28 Dec, 26

Salary

50000.0

Posted On

29 Sep, 26

Experience

4 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Yes

Skills

Industry

Information Technology & Services

Description

As a Senior Data Engineer (m/f/d) at SpotmyEnergy, you'll become part of an energetic team that's bringing the energy transition to homes! With us, you'll build and operate the backbone of our data organization – our data lake and BI platform on Databricks, as well as the airflow pipelines that keep our measurement and energy data flowing. Our data team sees itself as a service for the entire company, and that's exactly where you come in.

You will model and optimize our PostgreSQL and time-series databases, consider monitoring and alerting from the outset, and ensure that every squad has access to clean, well-documented data. With modern tools on AWS and a supportive team, you will build a platform that grows with us.

Your responsibilities

Setting up and operating our data lake and BI platform on Databricks
Design, construction and maintenance of airflow pipelines for measurement and energy data
Modeling and optimization of our PostgreSQL and time series databases
Responsibility for monitoring, alerting, and incident response, so that problems are detected early instead of late.
Providing clean, well-structured data as a service to all squads, including in-house deep-dive analyses when required.
Technical development of the data platform, including the selection and introduction of new tools where they provide real added value.
Documentation and active knowledge sharing within the team, instead of keeping knowledge only in one's own head.
Close collaboration with the data science team, which should be able to rely on the platform as a foundation.

Your profile

Several years of experience in building and operating productive data platforms or data lakes
Solid knowledge of Databricks/Spark and Airflow or comparable orchestration tools
Excellent SQL skills, deep PostgreSQL experience, experience with time-series databases like TimescaleDB, and secure Python proficiency.
Confident handling of AWS, ideally including managed Airflow via Astronomer and Databricks as a hosted service
A true reliability mindset – monitoring, alerting and potential error scenarios are considered from the very beginning.
A strong team player with fluent German skills and experience in the energy sector is a plus.

Our offer

Mission & Growth: Become part of a high-growth scale-up that is actively driving the energy transition with smart, scalable solutions.
Impact at all levels: With us, you build the data platform that the entire company relies on, and see directly how your work influences every squad and every decision in the company.
Spot Spirit: A motivated, appreciative team with short communication channels, open communication, and events that bring us closer together.
Flexibility: Modern, hybrid-friendly work environment with plenty of creative freedom and personal

Responsibilities

Your responsibilities

Setting up and operating our data lake and BI platform on Databricks
Design, construction and maintenance of airflow pipelines for measurement and energy data
Modeling and optimization of our PostgreSQL and time series databases
Responsibility for monitoring, alerting, and incident response, so that problems are detected early instead of late.
Providing clean, well-structured data as a service to all squads, including in-house deep-dive analyses when required.
Technical development of the data platform, including the selection and introduction of new tools where they provide real added value.
Documentation and active knowledge sharing within the team, instead of keeping knowledge only in one's own head.
Close collaboration with the data science team, which should be able to rely on the platform as a foundation.

Your profile

Several years of experience in building and operating productive data platforms or data lakes
Solid knowledge of Databricks/Spark and Airflow or comparable orchestration tools
Excellent SQL skills, deep PostgreSQL experience, experience with time-series databases like TimescaleDB, and secure Python proficiency.
Confident handling of AWS, ideally including managed Airflow via Astronomer and Databricks as a hosted service
A true reliability mindset – monitoring, alerting and potential error scenarios are considered from the very beginning.
A strong team player with fluent German skills and experience in the energy sector is a plus.

Our offer

Mission & Growth: Become part of a high-growth scale-up that is actively driving the energy transition with smart, scalable solutions.
Impact at all levels: With us, you build the data platform that the entire company relies on, and see directly how your work influences every squad and every decision in the company.
Spot Spirit: A motivated, appreciative team with short communication channels, open communication, and events that bring us closer together.
Flexibility: Modern, hybrid-friendly work environment with plenty of creative freedom and personal