Data Engineer

at  Digital Waffle

DAY-TO-DAY TASKS

• Work across the group and with the devisions data partners to leverage all available data, building out the groups database, reporting and insights capabilities to enable data-led decision making.
• Design, develop and maintain scalable, user-friendly and automated systems, data solutions and reporting that will support our analytical and business needs.
• Support the insight team with visualisations, reporting and stakeholder engagement through monthly/quarterly/annual departmental reviews
• Use data science/statistical modelling tools in collaboration with the analyst team and departmental stakeholders to develop Artificial Intelligence (AI) and Machine Learning (ML) functions and analytics.
• Create and manage a knowledge-base, including documentation of your designs (e.g., system design, functional design, data flow design) ensuring there is version control and contingency processes for all aspects.

REQUIRED SKILLS AND EXPERIENCE FOR THE ROLE

• Demonstrable experience or certification(s) within the field of data engineering, data science, and/or business analysis.
• Practical experience of database design and data transformation, supported by ETL processing.
• Managing data pipelines & orchestration that enable the transfer and processing of data. (Databricks, Microsoft Fabric, Alteryx. Snowflake, Apache)
• Coding and programming, capable of working through complex problems with others from the team, adapting quickly to changing market trends and business needs. (SQL, Python or R)
• Utilising cloud-based services and corresponding toolsets. (Microsoft Azure, GCP, AWS or similar).
• Comfortable handling structured and unstructured data, from 1st, 2nd, and 3rd party data sources, combining multiple data sets, to produce a cohesive picture of performance and derive insights and recommendations.
• Experience working directly with business stakeholders ensuring complex information is articulated in a meaningful way.