Senior Data Engineer at IDPP
London, Devon - England, United Kingdom -
Full Time


Start Date

Immediate

Expiry Date

07 Jan, 27

Salary

30000.0

Posted On

09 Oct, 26

Experience

1 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

No

Skills

Industry

Information Technology & Services;Software Development & Publishing

Description

About the job


Senior Data Engineer


Location: Sheffield or Birmingham


A leading global financial services organisation is seeking a Senior Data Engineer to join its

Cybersecurity Science & Analytics function.

The successful consultant will join a multi-skilled Platform & Data Engineering team responsible for

delivering engineering capabilities across a strategic cybersecurity data lake and analytics platform.

The role combines data engineering, cloud infrastructure, automation, platform operations and

production support responsibilities.


Responsibilities

• Design, develop and optimise cloud-based data pipelines and ETL workflows.

• Ingest data from internal and external sources into enterprise data platforms.

• Create and maintain curated datasets and reusable data assets.

• Improve reliability, automation and operational resilience of data services.

• Support Azure cloud infrastructure and data platform operations.

• Work closely with engineering teams to onboard new data sources and define schemas.

• Contribute to exploratory data analysis and platform enhancement initiatives.

• Support real-time analytics and data availability improvements.


Essential Skills

• Strong Data Engineering experience.

• Azure cloud platform expertise.

• Enterprise ETL and data pipeline development.

• Python or equivalent scripting experience.

• SQL and/or Kusto Query Language (KQL).

• GitHub and CI/CD practices.

• Linux administration and scripting.

• Infrastructure as Code, ideally Terraform.

• Azure DevOps.

• SRE / production support experience.


Desirable Skills

• Azure Data Factory

• Databricks

• Unity Catalog

• Synapse Analytics

• Kubernetes• Azure Functions

• Logic Apps

• Kafka or Azure Event Hubs

• Spark Streaming

• Prometheus

• Grafana

• Elasticsearch

• Cosmos DB

• Power BI

• SIEM and SOAR platforms


Experience

• Large enterprise environments

• Cloud-based data platforms

• Data lake architecture and delivery

• Regulated industries advantageous

• Cybersecurity experience beneficial but not essential


Working Environment

• Collaborative global engineering team

• Multi-disciplinary technology environment

• Strong learning and development culture

• Exposure to cybersecurity, cloud platform engineering and advanced analytics

About the job


We're looking for a Senior Data Engineer to lead the design, development and optimisation of enterprise-wide integration solutions across the Azure data platform. You'll play a key role in building scalable, secure and reliable data integrations, working closely with technical and business stakeholders.


Key Responsibilities

  • Lead the design and delivery of scalable integration solutions using Azure Logic Apps, Microsoft Fabric and the wider Azure ecosystem.
  • Connect business critical applications, data platforms, and third-party systems through scalable and secure integrations.
  • Drive best practices around integration architecture, governance, automation, and DevOps delivery.
  • Work closely with technical and business stakeholders to deliver secure, reliable, and high-performing data solutions.
  • Support and enhance automated deployments and continuous improvement through Azure DevOps.
  • Provide technical leadership, mentoring, and guidance to junior team members while helping shape the future integration roadmap.


Experience & Skills

  • 5+ years' experience in Data Integration, Data Engineering or Automation.
  • Strong experience in Azure Logic Apps and other Azure services such as Storage Accounts, Key Vault, Azure Functions and API Management.
  • Experience of developing Analytics solutions using Microsoft Fabric or comparable Azure PaaS services (Azure Data Factory, Synapse).
  • Solid understanding of REST APIs, authentication methods and modern integration patterns.
  • Experience implementing CI/CD pipelines using Azure DevOps and Infrastructure-as-Code tooling (ARM, Bicep. Terraform).
  • Knowledge of data modelling, governance, and integration best practices.


Apply now with your CV. Shortlisted candidates will be contacted to discuss the opportunity further.

Job search faster with P


How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities

About the job


We're looking for a Senior Data Engineer to lead the design, development and optimisation of enterprise-wide integration solutions across the Azure data platform. You'll play a key role in building scalable, secure and reliable data integrations, working closely with technical and business stakeholders.


Key Responsibilities

  • Lead the design and delivery of scalable integration solutions using Azure Logic Apps, Microsoft Fabric and the wider Azure ecosystem.
  • Connect business critical applications, data platforms, and third-party systems through scalable and secure integrations.
  • Drive best practices around integration architecture, governance, automation, and DevOps delivery.
  • Work closely with technical and business stakeholders to deliver secure, reliable, and high-performing data solutions.
  • Support and enhance automated deployments and continuous improvement through Azure DevOps.
  • Provide technical leadership, mentoring, and guidance to junior team members while helping shape the future integration roadmap.


Experience & Skills

  • 5+ years' experience in Data Integration, Data Engineering or Automation.
  • Strong experience in Azure Logic Apps and other Azure services such as Storage Accounts, Key Vault, Azure Functions and API Management.
  • Experience of developing Analytics solutions using Microsoft Fabric or comparable Azure PaaS services (Azure Data Factory, Synapse).
  • Solid understanding of REST APIs, authentication methods and modern integration patterns.
  • Experience implementing CI/CD pipelines using Azure DevOps and Infrastructure-as-Code tooling (ARM, Bicep. Terraform).
  • Knowledge of data modelling, governance, and integration best practices.


Apply now with your CV. Shortlisted candidates will be contacted to discuss the opportunity further.

Job search faster with P


Loading...