About the job

Lead Data Engineer (SC Cleared)

Contract: Inside IR35

Rate: Up to £425 per day

Location: Remote

Clearance: Active SC Clearance required

We're supporting a major government digital transformation programme and are seeking an experienced Lead Data Engineer to provide technical leadership across the design, delivery and governance of enterprise-scale cloud data platforms.

This is an excellent opportunity to lead a team of engineers working on complex, high-volume data solutions within a modern AWS-based data environment.

What You'll Be Doing

Leading data engineering delivery across multiple workstreams, ensuring high-quality sprint outputs and technical excellence
Designing complex data pipeline patterns for large and highly complex datasets
Defining and governing reusable data engineering standards, frameworks and best practices
Leading the implementation of Change Data Capture (CDC), incremental loading and large-scale data ingestion solutions
Conducting technical design reviews and code reviews to ensure performance, scalability and maintainability
Supporting the successful handover of reusable patterns and solutions across delivery teams
Mentoring and developing Data Engineers within an agile environment

Essential Skills

Extensive experience leading Data Engineering teams and projects
Expertise in large-scale data pipeline design and architecture
Strong experience with Change Data Capture (CDC) and incremental data loading
Data engineering pattern development and governance
Technical leadership, mentoring and code review experience
Strong cloud data platform experience within AWS environments
Infrastructure as Code using Terraform

Technical Environment

AWS Glue
Amazon S3
MWAA (Managed Workflows for Apache Airflow)
Apache Iceberg
Python
PySpark
Terraform

Requirements

Active SC Clearance is essential
Proven experience delivering complex cloud data solutions within enterprise-scale environments
Strong stakeholder engagement and technical leadership capabilities
Ability to guide engineering standards and best practices across a delivery team

This fully remote contract offers the opportunity to play a key role in the delivery of a large-scale public sector data transformation programme, leading the design and implementation of modern cloud-native data solutions.

See curated AI tools for your job s

How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities