Data Engineer

at  Imperial College London

ESSENTIALS

• Expert skills in Azure Data Factory.
• Expert skills in utilising Databricks for data transformations.
• Extensive experience in coding in Python & PySpark programming language.
• Advanced SQL hands-on skills.
• Expert skills in building data pipelines.
• Experience in using RDBMS (SQL Server, Oracle..).
• Good understanding of dimensional modelling (Star Schema).
• Experience working with DevOps solutions.
• Experience with Agile delivery methods.
• Willingness to continually learn and improve, including prototyping and testing new technologies and ways of working.
• Problem solver – seeking to find the right solution to deliver value.

• Clear communicator – both written and verbal.

  Desirable

• Experience in Lakehouse Architecture.

• Experience in Data Domain Architecture (or Data Mesh).
• Experience working with APIs.
• NoSQL database knowledge.

AVAILABLE DOCUMENTS

Attached documents are available under links. Clicking a document link will initialize its download.

• Download: Data Engineer Job Description.Pdf
• Download: Employee Benefits Booklet.Pdf

Please note that job descriptions are not exhaustive, and you may be asked to take on additional duties that align with the key responsibilities mentioned above.
We reserve the right to close the advert prior to the closing date stated should we receive a high volume of applications. It is therefore advisable that you submit your application as early as possible to avoid disappointment.
If you encounter any technical issues while applying online, please don’t hesitate to email us at support.jobs@imperial.ac.uk. We’re here to help.

ABOUT THE ROLE

You will be instrumental in scaling the central data platform of a world class university working within a collaborative and dynamic team composed of Data Engineers and Business Intelligence Analysts. In this role you will craft enterprise-level Data Engineering solutions using Azure data engineering tools. Responsibilities include developing data-pipelines, supporting the Azure data platform and developing Imperial College London’s data and analytics capabilities.

WHAT YOU WOULD BE DOING

• You will be hands on working with Azure Data Factory and Databricks to build end-to-end data pipelines, including writing quality code and adhering to guidelines.
• You will be working closely with other data engineers, product engineers, data analysts and business users.
• You will be driving best practices, standards, and naming conventions.
• You will be enhancing and maintaining the data platform.
• You will be ensuring that data quality, governance and security is in place.