Data Engineering Specialist

at  Cadent Gas

At Cadent we’re excited to be part of the future of UK energy! We’ve got a clear roadmap that will drive our performance to the forefront of our industry and support the UK government in achieving its net zero targets by 2050.
We’re making a difference through innovation and new ways of working. Together we’re shaping a cleaner, greener future for our 11 million customers whom we put at the heart of everything we do.
As an Data Engineering Specialist at Cadent, you will develop high-quality reusable enterprise level data that is utilised for regulatory, operational and analytic reporting and insights in order to provide a timely visibility for various business functions into company’s performance and main operational KPIs and ensure that the stakeholders can maximise the value from Cadent data by innovating in areas of AI, Machine Learning and Data Science.

SKILLS AND EXPERIENCE

• Educated to degree level or equivalent in Computer Science, Software Development or similar
• In depth knowledge of SQL programming language.
• Experience in application development on SAP BW4/Hana or Data Warehouse Cloud systems.
• Experience processing, filtering, transforming, and presenting data.
• Strong technical experience and good command of industry trends.
• Strong communication, critical thinking, and analytical skills.
• Experience working with data from SAP
• Data modelling methodologies (LSA++, Dimensional, etc.), SQL, CDS views.
• Experience of working in a DevOps environment and delivering software using the Agile delivery framework would be desirable.
• Experience in working with: DataFrames for big data, Delata Tables, APIs, efficient configuration of Apache Spark, Databricks, Spark SQL,
• Experience in management of notebooks, data objects, jobs and clusters; Design and schedule workflows to run at specific times or trigger them based on events or conditions
• Experience in scheduling and automating tasks in Databricks, such as data processing, machine learning model training, or report generation
• Ability to use relevant APIs and connectors to efficiently read data from cloud storage into Databricks DataFrames or Delta Tables
• Manipulation and transformation of data using user-defined functions (UDFs) to derive insights or prepare it for further analysis
• Understanding the data flow and dependencies between different data sources using data lineage and Unity Catalog

KEY RESPONSIBILITIES

• Appropriate application of Enterprise Data Modelling techniques to conceptualise the relationships between types of information within the organisation.
• Create Enterprise Data Models enabling effective storage and interaction for a wide range of company data and use cases.
• Assessing issues that might prevent the organisation from making maximum use of its information assets.
• Contributes to organisational policies, standards, and guidelines for data engineering.
• Introduce appropriate controls within the processes to ensure the data processing adheres to company policies in areas of Privacy, Data Retention and Security.
• Planning and driving the development of data engineering solutions ensuring that solutions balance functional and non-functional requirements.
• Monitorthe application of data standards and architectures including security and compliance.
• Create data flows and modelling objects in SAP Datasphere data builder- creation of relational and analytical datasets, fact models, dimension and SQL views based
• Create complex ABAP CDS views and SQL code with associated documentation to quality standards while also adhering to SAP best practices and policies.
• Designs and implements data pipelines and data stores to acquire and prepare data in SAP Datasphere in line with data engineering standards and tools.
• Ensuring that the development activities are implementing the quality standards as set by the customer & test teams and that identified test outputs are fed back into the development lifecycle as part of a total quality system.
• Working within development sprints using an agile software delivery model, across multiple product lines and developments, undertaking retrospectives, ‘show & tell’ as part of an incremental and iterative approach to product development.
• Responsible for development of standardised Datasphere models used for developing reports and analysis in SAP Analytics Cloud, PowerBi and other data consuming applications.

Here at Cadent, we are committed to supporting our employees to get the best out of themselves. For this role in particular we can offer:

• Funding and support towards completing qualifications
• Ample opportunity for progression within the business
• Mentoring and guidance opportunitie