ABOUT US

The Department for Business and Trade (DBT) has a clear mission - to grow the economy. Our role is to help businesses invest, grow and export to create jobs and opportunities right across the country. We do this in three ways.
Firstly, we help to build a strong, competitive business environment, where consumers are protected and companies rewarded for treating their employees properly.
Secondly, we open international markets and ensure resilient supply chains. This can be through Free Trade Agreements, trade facilitation and multilateral agreements.
Finally, we work in partnership with businesses every day, providing advance, finance and deal-making support to those looking to start up, invest, export and grow.
The Digital, Data and Technology (DDaT) directorate develops and operates tools and services to support us in this mission. The team have been nominated three times in a row for ‘Best Public Sector Employer’ at the Women in Tech awards!

SKILLS AND EXPERIENCE

It is essential that you have:

• The ability to write optimised and maintainable SQL and Python for data ingestion and transformation (LEAD)
• Demonstratable experience in developing and maintaining enterprise-level data solutions
• experience in quality assurance and implementing testing, for example using pytest
• Proficiency with the command line and git
• The ability to apply automation and use continuous integration / continuous deployment workflows, for example using GitHub actions
• Experience using agile methodologies on data projects
• Some experience in direct/indirect line management such as developing and coaching others

It is desirable that you have experience of working with:

• Cloud technologies, especially AWS, and infrastructure-as-code tools such as Terraform
• Docker and container-based workflows

TECHNICAL SKILLS

• Data modelling. You understand the concepts and principles of data modelling and can produce, maintain and update relevant data models for specific business needs. You know how to reverse-engineer data models from a live system.

• Problem resolution (data). You respond to problems in databases, data processes, data products and services as they occur. You initiate actions, monitor services and identify trends to resolve problems. You determine the appropriate remedy and assist with implementation of it as well as preventative measures.

• Programming and build (data engineering). You can design, code, test, correct and document programs or scripts using Python and SQL. You can use source control to manage your code.
• Testing. You can review requirements, specifications and define test conditions. You can identify issues and risks associated with work while being able to analyse and report test activities and results.
• Data development process. You can design, build and test data products based on feeds from multiple systems using a range of different data exchange, storage and access technologies. You can create testable, repeatable and reusable products.

ABOUT THE ROLE

Data engineers at the DBT are pivotal to our mission of driving economic growth by placing data at the heart of decision-making. We leverage leading cloud and open-source technology to build scalable, business-critical data pipelines, products and services, ensuring our users—whether within DBT, across government, or the public— have access to the right data in the optimal format.
Our cross-functional, agile teams work collaboratively on a range of projects spanning from internal AI agents, to our data science and analytics platform, to our system for managing the UK Tariff, and beyond. Data engineers also belong to a vibrant community (both within DBT and across government) who share and promote best practice.
We are seeking a collaborative problem-solver to join our profession and help deliver more for our users. You will be confident in using languages like SQL and Python to deliver robust data products and have some experience supporting more junior members of the team.

If successful, you’ll get the opportunity to work with a range of technology including:

• Airflow and a range of AWS services to build robust, scalable data pipelines
• Terraform to manage our Postgres backed data platform

MAIN RESPONSIBILITIES

You will:

• Design, build, and test data products: Develop robust data products by integrating feeds from multiple systems, utilising a variety of storage technologies and access methods.
• Implement resilient and scalable solutions: Select and deploy the most suitable technologies to create data solutions that are resilient, scalable, and future proof.
• Problem-solving expertise: Use your understanding of common issues in databases, data processes, products, and services, and apply standard solutions effectively.
• Stakeholder collaboration: Work closely with a diverse range of stakeholders to understand their requirements, establish project goals, and define deliverables.
• User support and issue resolution: Assist users in utilising data tools, resolve issues promptly, and escalate when necessary.
• Promote best practices: Develop and advocate for best practices within the team.
• Team building and development: Organise initiatives to foster team building and professional development.
• Mentorship and management: Provide line management and support to junior team members, guiding their growth and development.
• Continuous improvement: Stay informed about the latest trends and best practices in data engineering to drive continuous improvement.