Senior Data Engineer

at  Department for Work and Pensions

JOB SUMMARY

Please note this role requires you to pass Security Check clearance. For further information, please see ‘Selection process details’.
DWP is the UK’s largest government department. We help people into work and make payments worth over £195bn a year to support some of the most vulnerable people in our society.
DWP Digital creates digital services that almost everyone in the UK relies on at some point in their lives. We’re carrying out a once-in-a-generation digital transformation - a task of size and scale unmatched elsewhere. We’re revamping our users’ digital experiences to make significant changes for our 22 million customers.
You’ll apply data engineering on a massive scale, influencing issues which affect millions of citizens and making a real difference to how the UK works.

JOB DESCRIPTION

You’ll join a close-knit team at the heart of one DWP’s highest priority transformation projects – the Health Transformation Programme. This team is responsible for both the Personal Independence Payments (PIP) and Health Assessment services.
Working with huge datasets (quite possibly the largest on offer in the UK), you’ll be delivering benefits that positively impact thousands of UK citizens.
Data modelling is key in this role – you’ll be running platforms and transforming raw data into model raw datasets. Our production environment is currently on-prem, but the direction of travel is cloud engineering. You’ll be executing code in different places across the following tech stack: Azure, Databricks, PySpark and Pandas.
You will steer the data engineering function within a wider product team. There’ll be lots of connecting and interaction with stakeholders – you’ll work closely with product and delivery managers, business analysts and data scientists.
You’ll manage a small team of data engineers and will also oversee specialist contractor data engineers. You’ll explore new ideas and support your team in developing their technical and interpersonal skills. Your time will roughly be split 70% data engineering and 30% leadership, strategy and management.
We care about our employees and can offer you an environment that is family-friendly, supportive and inclusive in an organisation with real social purpose.

TECHNICAL SKILLS

We’ll assess you against these technical skills during the selection process:

• Technical Breadth

Benefits

• An employer pension contribution of up to 28.97% For further information please click here.
• Annual leave rising up to 30 days, (based on your working pattern).
• Family friendly flexible working arrangements, such as hybrid working, job sharing, term-time working, flexi-time and compressed hours.
• Learning and development tailored to your role this could include industry recognised qualifications, coaching and mentoring.
• An inclusive and diverse environment with opportunities to join staff networks including: Women’s Network, National Race Network, National Disability Network (THRIVE) and many more.

This job role may be suitable for hybrid working, which is where an employee works part of the week in their DWP office and part of the week from home. This is a voluntary, non-contractual arrangement and your office will be your contractual place of work. The number of days that anyone will be able to work at home will be determined primarily by business need but personal circumstances and other relevant circumstances will also be taken into account. If you are successful, any opportunities for hybrid working, including whether a hybrid working arrangement is suitable for you, will be discussed with you prior to you taking up your post.

NATIONALITY REQUIREMENTS

This job is broadly open to the following groups:

• UK nationals
• nationals of the Republic of Ireland
• nationals of Commonwealth countries who have the right to work in the UK
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window)
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
• individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
• Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service

Further information on nationality requirements (opens in a new window)

TYPE OF ROLE

Analytical
Architecture and Data
Digital
Information Technology

FOR MEANINGFUL CHECKS TO BE CARRIED OUT, YOU WILL NEED TO HAVE LIVED IN THE UK FOR A SUFFICIENT PERIOD. WHILST A LACK OF UK RESIDENCY IS NOT NECESSARILY A BAR TO SECURITY CHECK CLEARANCE, AN EXPECTATION OF UK RESIDENCY MAY RANGE FROM THREE TO FIVE YEARS. FAILURE TO MEET THE RESIDENCY REQUIREMENTS NEEDED FOR THIS ROLE MAY RESULT IN THE WITHDRAWAL OF YOUR OFFER.

For further information on National Security Vetting please visit the following page https://www.gov.uk/government/publications/demystifying-vetting