Senior Data Engineer at Caspian One
London, Devon - England, United Kingdom -
Full Time


Start Date

Immediate

Expiry Date

07 Jan, 27

Salary

30000.0

Posted On

09 Oct, 26

Experience

1 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

No

Skills

Industry

Information Technology & Services;Software Development & Publishing

Description

About the job


Senior Data Engineer


Location: Sheffield or Birmingham


A leading global financial services organisation is seeking a Senior Data Engineer to join its

Cybersecurity Science & Analytics function.

The successful consultant will join a multi-skilled Platform & Data Engineering team responsible for

delivering engineering capabilities across a strategic cybersecurity data lake and analytics platform.

The role combines data engineering, cloud infrastructure, automation, platform operations and

production support responsibilities.


Responsibilities

• Design, develop and optimise cloud-based data pipelines and ETL workflows.

• Ingest data from internal and external sources into enterprise data platforms.

• Create and maintain curated datasets and reusable data assets.

• Improve reliability, automation and operational resilience of data services.

• Support Azure cloud infrastructure and data platform operations.

• Work closely with engineering teams to onboard new data sources and define schemas.

• Contribute to exploratory data analysis and platform enhancement initiatives.

• Support real-time analytics and data availability improvements.


Essential Skills

• Strong Data Engineering experience.

• Azure cloud platform expertise.

• Enterprise ETL and data pipeline development.

• Python or equivalent scripting experience.

• SQL and/or Kusto Query Language (KQL).

• GitHub and CI/CD practices.

• Linux administration and scripting.

• Infrastructure as Code, ideally Terraform.

• Azure DevOps.

• SRE / production support experience.


Desirable Skills

• Azure Data Factory

• Databricks

• Unity Catalog

• Synapse Analytics

• Kubernetes• Azure Functions

• Logic Apps

• Kafka or Azure Event Hubs

• Spark Streaming

• Prometheus

• Grafana

• Elasticsearch

• Cosmos DB

• Power BI

• SIEM and SOAR platforms


Experience

• Large enterprise environments

• Cloud-based data platforms

• Data lake architecture and delivery

• Regulated industries advantageous

• Cybersecurity experience beneficial but not essential


Working Environment

• Collaborative global engineering team

• Multi-disciplinary technology environment

• Strong learning and development culture

• Exposure to cybersecurity, cloud platform engineering and advanced analytics


Responsibilities

About the job


Senior Data Engineer


Location: Sheffield or Birmingham


A leading global financial services organisation is seeking a Senior Data Engineer to join its

Cybersecurity Science & Analytics function.

The successful consultant will join a multi-skilled Platform & Data Engineering team responsible for

delivering engineering capabilities across a strategic cybersecurity data lake and analytics platform.

The role combines data engineering, cloud infrastructure, automation, platform operations and

production support responsibilities.


Responsibilities

• Design, develop and optimise cloud-based data pipelines and ETL workflows.

• Ingest data from internal and external sources into enterprise data platforms.

• Create and maintain curated datasets and reusable data assets.

• Improve reliability, automation and operational resilience of data services.

• Support Azure cloud infrastructure and data platform operations.

• Work closely with engineering teams to onboard new data sources and define schemas.

• Contribute to exploratory data analysis and platform enhancement initiatives.

• Support real-time analytics and data availability improvements.


Essential Skills

• Strong Data Engineering experience.

• Azure cloud platform expertise.

• Enterprise ETL and data pipeline development.

• Python or equivalent scripting experience.

• SQL and/or Kusto Query Language (KQL).

• GitHub and CI/CD practices.

• Linux administration and scripting.

• Infrastructure as Code, ideally Terraform.

• Azure DevOps.

• SRE / production support experience.


Desirable Skills

• Azure Data Factory

• Databricks

• Unity Catalog

• Synapse Analytics

• Kubernetes• Azure Functions

• Logic Apps

• Kafka or Azure Event Hubs

• Spark Streaming

• Prometheus

• Grafana

• Elasticsearch

• Cosmos DB

• Power BI

• SIEM and SOAR platforms


Experience

• Large enterprise environments

• Cloud-based data platforms

• Data lake architecture and delivery

• Regulated industries advantageous

• Cybersecurity experience beneficial but not essential


Working Environment

• Collaborative global engineering team

• Multi-disciplinary technology environment

• Strong learning and development culture

• Exposure to cybersecurity, cloud platform engineering and advanced analytics


Loading...