Hybrid requirements: This role has flexible working patterns.
Application question:
Have you lived in the UK continuously for the last 4.5 years?
As a Senior Data Engineer, you may play one or more roles according to our clients’ needs. The role is very hands-on and you’ll support as a senior contributor role for a project, focusing on both delivering engineering work as well as upskilling members of the client team. At other points, you might play more of a technical architect role and work with the larger MadeTech team to identify growth opportunities within the account.
You’ll need to have a drive to deliver outcomes for users. You’ll make sure that the wider context of a delivery is considered and maintain alignment between the operational and analytical aspects of the engineering solution.

SKILLS, KNOWLEDGE AND EXPERTISE

We are looking for candidates with a range of skills and experience, please apply even if you don’t meet all the criteria.
Enthusiasm for learning and self-development
Proficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategies
Gathering and meeting the requirements of both clients and users on a data project
Strong experience in IaC and able to guide how one could deploy infrastructure into different environments
Owning the cloud infrastructure underpinning data systems through a DevOps approach
Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop
Good understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data Meshes) and the different use cases for them
Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines. With an understanding how to create reusable libraries to encourage uniformity of approach across multiple data pipelines.
Able to document and present an end-to-end diagram to explain a data processing system on a cloud environment, with some knowledge of how you would present diagrams (C4, UML etc.)
To provide guidance how one would implement a robust DevOps approach in a data project. Also would be able to talk about tools needed for DataOps in areas such as orchestration, data integration and data analytics.
Experience in improving resilience into a project by checking for software vulnerabilities and implement appropriate testing strategies (unit, integration, data quality etc.)
Knowledge of SOLID, DRY and TDD principles and how to practically implement these into a project.
Agile practices such as Scrum, XP, and/or Kanban
Designing and implementing efficient data transformation processes at scale, both in batch and streaming use cases
Owning the cloud infrastructure underpinning data systems through a DevOps approach
Agile practices such as Scrum, XP, and/or Kanban
People skills such as mentoring, supportive team player and performing line management duties
To be able to demonstrate a commercial mindset when on projects to grow accounts organically with senior stakeholders

DESIRABLE EXPERIENCE

Experience in the following things isn’t essential, but it’s highly desirable!
Working at a technology consultancy
Working with Docker and virtual environments as part of the development and CI/CD process.
Working with senior stakeholders to gather requirements and keep them engaged with
Experience in working with a team of engineers using a variety of techniques such as pair programming or mob programming.
Working with data scientists to productionise advanced data deliverables, such as machine learning models
Working knowledge of statistics
Working with multidisciplinary digital and technology teams
Working within the public sector
See more
Role tech stack
Git
Apache Spark
Azure Databricks
Hadoop
Docker
Life at
Made Tech
Browse all roles
Culture overview
We are TransparentWe’re building an open and transparent company across the UK, full of people who are passionate about their work, who always strive to be better, who love to help others grow and who care about using digital and technology to create a better, fairer society.We Make a DifferenceWe focus our efforts on building meaningful, open source services that can help improve citizens’ lives. We find this type of work more challenging and more rewarding. Less short-lived, throwaway projects, more mission-critical systems and services.We Continuously ImproveWe see the importance and value in self-improvement. We have regular code dojos, show and tells, reviews and other reflective practices we aim to encourage growth. One of the biggest ways we have committed to developing our skills is Learn Tech Fridays.We LearnLearn Tech consists of a number of tracks, where every Friday afternoon the whole company comes together to focus on learning new or developing existing skills. This is a constantly evolving programme and we are working with our team’s feedback to keep improving it going forward. We support individuals with 12 days’ paid learning each year, plus an individual learning budget.We are here to stayWe are building a lasting organisation in which our people can grow with the business. We try to think hard about how to best approach every aspect of what we do to create the most enjoyable and productive environment.We are InclusiveWe want to foster a diverse, happy and well-supported team. D&I isn’t just something we pay lip service to. The services we help build will be used by people around the country. So it’s important to us that the teams that build them reflect this diversity too. Wherever you are on your career path. Whatever your background and experience. If you’re passionate about using technology to make life better for everyone, we absolutely want to hear from you.CertificationsWe see workplace engagement as a vital part of our continued success in empowering our employees to have a positive impact on the public sector. We are extremely proud to have received certifications from Best Companies for our continued commitment to making Made Tech a great place to work.Technology’s 50 Best Companies to Work For in London for 2021Technology’s 50 Best Companies to Work For in the South West for 2021Outstanding to Work for 2-Star Accreditation for 2021
See more
Employee benefits
Cycle To Work
Flexible Hours
Flexible Working
Laptop
Learning Allowance
Life Insurance
Pension
Season Ticket Loan
Unlimited Holidays
Office vibe

Please refer the Job description for details