Senior Azure Databricks Data Engineer

at  wega Informatik

We are a Pharma and Life Science IT service provider that has been successfully carrying out ‘state-of-the-art’ projects for international customers for more than 30 years.
We are a dynamic forward-thinking and expanding organization with a great team spirit and always on the lookout for like-minded individuals. If you are driven by ambition and highly motivated by challenging jobs, as well as financial incentives, you have come to the right place.
With our attractive compensation and fringe benefits model, this is a great opportunity to maximize your earning potential. The further development of our colleagues and team members coupled with an excellent work atmosphere are amongst the top values of our company.

YOUR QUALIFICATION AND EXPERIENCE:

• University Degree or an equivalent educational background
• Highly trained and strong working experience in implementing Azure DataBricks application architecture and infrastructure
• Proven track record as a DataBricks platform engineer and Azure Cloud architecture
• Working experience with automated testing in non-GxP environment incl. understanding of validation process
• Skilled in Azure DevOps incl. maintenance and planning of work items, dependencies etc.
• Implement CI/CD pipelines
• Has working experience with Documentation as Code (DaC) and Infrastructure as Code (IaC), particularly within the Databricks platform architecture
• Has experience working in the Pharma industry in recent years
• Familiar with engineering processes within a QMS

GENERAL PERSONAL SKILLS:

• Team player, adheres to deadlines and planning, good command of English, in order to also present topics to different stakeholders
• Self-motivating professional that is action driven and solution focused
• Creative thinker and able to challenge the current status quo
• Flexibility to travel to customer’s premises (20%)

• Collaborate with various product teams to understand business requirements and translate them into design specifications and contribute to evolve the platform architecture
• Implement a robust, scalable, and secure data platform for pharma R&D based on Azure Databricks and Azure Cloud architecture
• Conduct technology spikes to evaluate which technology best fits evolving business requirements and platform architecture
• Implement DevOps practices for provisioning infrastructure (IaC), and data pipelines (DAB), including CI/CD using Azure DevOps, with automation, monitoring, and alerting
• Ensure data quality and integrity through establishing testing and validation procedures as part of the release process in a non-GxP environment
• Monitor and troubleshoot infrastructure and pipelines to resolve any issues promptly.
• Embrace the Agile methodology to ensure fast and incremental delivery
• Stay tuned with the latest industry trends and best practices in data engineering and cloud architecture, specifically around Databricks, Azure, AWS.