Senior Data Engineer

at  Skillspark AB

START

DURATION> 12 months
Industry: Pharmaceutical
Remote work: Remote (occasional trips to the Warsaw and Denmark offices)
Renumeration: 150 - 190 PLN/h + VAT (depending on experience)
Assignment type: B2B
Start: ASAP
Project length: 12 months + ext.
Project language: English

REQUIREMENTS:

• Strong proficiency in Python programming
• Extensive experience with Azure, including Azure Data Factory and Azure Databricks, and a deep understanding of Azure architecture and services
• Experience in using Spark, including Spark SQL and understanding of how to optimize Spark performance.
• Automated unit testing and code quality inspection
• CI/CD Pipelines using Azure DevOps (or similar)
• Fluent spoken and written English
• Working in pharma domain or other regulated area is considered an advantage

• Collaborate with cross-functional teams to design, develop and maintain data pipelines and analytics solutions.
• Design and build a foundational platform for a modern data lake architecture, optimizing it for scalability, flexibility, and performance.
• Develop automated test to ensure data accuracy and quality.
• You will assist with planning and maintaining the Azure architectural runway and pipeline for multiple products, ensuring their stability and efficient operation.
• Continuously secure improvement that can make developers on the platform work even more efficiently and act as a sparring partner on use of Azure services for the organisation.
• Leverage your expertise in cloud development to design and implement innovative digital solutions focused on delivering business insights and patient care in real time.
• Overall, our goal is to improve the clinical experience for patients, doctors and nurses world-wide, and your role will support this journey.