Senior Data Engineer (f/m/d)

at  Aleph Alpha

OVERVIEW:

Join our forward-thinking data team to drive the development of cutting-edge data solutions for Generative AI applications. We leverage data to empower our customers, fuel our own innovation, and support groundbreaking research. As a Senior Data Engineer, you will take a leadership role in designing, optimizing, and scaling our data infrastructure, ensuring that our solutions are not only robust but also capable of meeting the challenges of tomorrow.

• Lead the design and implementation of scalable data architectures to handle large-scale datasets (terabytes of text) with a focus on storage, versioning, and documentation best practices.
• Architect, develop, and oversee the maintenance of web services that enable efficient consumption of harvested data.
• Partner with researchers, software engineers, and leadership to continuously refine data collection methodologies and identify new data opportunities.
• Strategize and prepare large datasets for diverse Machine Learning use cases, with an emphasis on Generative AI.
• Build, optimize, and automate advanced preprocessing pipelines tailored to specific applications, ensuring high performance and reliability.
• Ensure data services are robust, scalable, and meet the needs of cross-functional teams developing new products on top of our data infrastructure.
• Mentor and guide junior data engineers, fostering a culture of knowledge sharing and continuous improvement.