About the job

Senior Data Platform Engineer

Contract | Remote | Inside IR35

We're partnering with a technology-driven organisation building a next-generation data platform that sits at the heart of its analytics, AI and real-time decision-making capabilities.

This is a genuine opportunity to work on a modern, cloud-native platform where you'll help shape architecture, engineering standards and platform capabilities rather than simply maintain existing solutions.

What You'll Be Doing

• Designing and building scalable batch and streaming data pipelines
• Developing event-driven architectures using Kafka and modern messaging platforms
• Building and maintaining cloud-native lakehouse architectures using Apache Iceberg
• Deploying and operating data workloads on Kubernetes-based platforms
• Designing reliable, observable and performant data products
• Working closely with engineering, analytics and AI teams to deliver scalable data capabilities
• Contributing to platform architecture, tooling decisions and engineering best practice
• Improving platform reliability, governance, data quality and operational excellence

Technology Environment

• Apache Kafka
• Apache Iceberg
• Kubernetes / EKS
• Python / PySpark
• Apache Airflow / Dagster
• Terraform
• Spark & Streaming Technologies
• AWS Cloud Platform
• Modern Lakehouse Architecture

What We're Looking For

• Strong experience designing and operating modern data platforms
• Expertise in Kafka and event-driven architectures
• Commercial experience with Apache Iceberg or similar lakehouse technologies
• Kubernetes and cloud-native engineering experience
• Strong Python and SQL skills
• Experience building scalable, production-grade data systems
• Ability to contribute to architecture decisions and platform strategy
• Comfortable working in greenfield and evolving environments

Nice to Have

• ClickHouse experience
• Apache Flink
• Debezium / CDC pipelines
• Data Mesh or Lakehouse implementations
• AI/ML platform experience
• Financial services, consumer technology or large-scale digital platform background

Why Join?

• Genuine greenfield engineering environment
• Modern technology stack
• High level of technical ownership
• Opportunity to influence architecture and engineering standards
• Work alongside experienced engineers solving complex distributed systems challenges
• Exposure to real-time analytics and AI-driven data initiatives

If you're an engineer who enjoys building platforms, solving complex technical problems and working with modern data technologies at scale, I'd love to speak with you