Azure Data Engineer, Analytics & BI

at  Luxoft

PROJECT DESCRIPTION

We are seeking an experienced Data Engineer (5-8 years’ experience) to design, implement, and maintain scalable and efficient data pipelines. This role requires extensive hands-on experience with ETL and ELT using tools like Azure Data Factory (ADF) and Fabric Solutions. The ideal candidate will be an individual contributor with a strong background in data ingestion, transformation, and loading processes.

SKILLS

Must have
?? 5-8 years of experience in data engineering with a focus on Azure.
?? Strong proficiency in Azure Data Factory, Python, and Azure Synapse.
?? Experience with data modelling, ETL processes, and SQL.
?? Familiarity with Azure DevOps for CI/CD pipelines.
?? Experience with data integration for different sources (SQL, APIs, Flat Files, Data Streams etc.)
?? Excellent problem-solving skills and attention to detail.
?? Strong communication and collaboration skills.
?? Ability to work independently and manage multiple tasks.
?? Bachelor’s degree in Computer Science, Information Systems, or a related field.
Nice to have
?? Experience in the financial industry or working with financial data.
?? Experience with Microsoft fabric.
?? Knowledge of data governance and data quality best practices.
?? Hands-on experience with Python in ETL processes.

?? Design, develop, and maintain data pipelines and ETL processes on Microsoft Azure.
?? Implement data integration solutions using Azure Data Factory, Fabric Notebooks, Spark jobs, Synapse, and other Azure services.
?? Collaborate with business stakeholders to gather requirements and ensure data solutions meet business needs.
?? Optimize data workflows for performance, scalability, and reliability.
?? Analysis & Troubleshooting: Debug and resolve complex issues with the data pipelines.
?? Ensure data accuracy, consistency, and security across all data pipelines.
?? Develop and maintain documentation for data processes and solutions.