Data Engineer

at  DataSource

INTRODUCTION

Our client is looking for a Data Engineer with experience working within a Consulting environment as they provide Data Engineering services to clients within the Critical National Infrastructure space.
They are looking for someone who is very confident with the full Azure stack, and have excellent technical knowledge of designing, building, and maintaining scalable data pipelines that will enable clients to extract value from their data assets.

SKILLS & EXPERIENCE

• Previous experience within a Consultancy environment as a Data Engineer.
• Requirements capture and ability to translate those requirements into viable solutions.
• Proven experience in at least some of the following: Databricks, Azure Data Factory, Azure Data Lake, Azure Synapse (and data warehousing approaches) or SSIS, Azure Analysis Services or DataOps.
• Programming experience of SQL, Python, Spark, DAX or C#.
• DevOps practices (CI/CD, GIT, Terraform etc.)
• Comprehensive and demonstrable experience in DevOps practices.
• Exceptional communication and stakeholder engagement skills.

KEY RESPONSIBILITIES

• Work on client engagements within Critical National Infrastructure.
• Understand and define components of the data landscape and how it relates to the data strategy.
• Understand and translate end-user requirements into designs and delivery plans for effective data solutions.
• Design, develop, execute, and maintain highly automated data pipelines using Azure.
• Analyse and resolve data quality issues.
• Build, maintain, and support data workflows and the necessary infrastructure as part of a data and analytics delivery team.
• Identify opportunities for improvement and promote theses through the team.
• Take knowledge or experience and translate into new ideas or solutions.
• Contribute to the development and maintenance of documentation and processes.