Data Engineer (Junior)

at  Discovery Ltd

Business Unit: Discovery Employee Benefits
Function: Data Sciences
Date: 4 Nov 2024
Achieve more than YOU BELIEVE
Discovery Corporate & Employee Benefits
Data Engineer (Junior)

PERSONAL ATTRIBUTES AND SKILLS

• Exceptional analytical, conceptual thinking and problem solving skills
• Excellent oral and written communication skills.
• Ability to understand entity-relationship diagrams, normalized and de-normalized structures
• Excellent planning, organizational, and time management skills
• Scope and size BI initiatives.
• Work breakdown management
• Coach and co-ordinate team members
• Data manipulation, storytelling, and visualization
• Experience in Excel Pivot

EDUCATION AND EXPERIENCE

• Honours or Master’s degree in BSc Computer Science specialising in Data Science or Data Engineering (Honours or Master’s), IT degree, Data Engineering or related.
• Experience in data pipelines, data modelling and machine learning (advantageous).
• 3 - 5 years working experience.
• A working knowledge of the Operations environment throughout Employee Benefits – Compass or Sonata (advantageous).
• Expert in programming languages such as MS SQL, Oracle PL\SQL, DAX, MQL, SSIS, (Mongo Query Language) and (R, Python, Scala,.Net or Java).
• Essential skills required (MS SQL, Oracle PL\SQL, DAX, MQL).
• Expert database knowledge in SQL and experience with MS Azure tools such as Data Factory, Synapse Analytics, Data Lake, Databricks, Azure stream analytics and PowerBI.
• Modern Azure data warehouse skills.
• Expert Unix/Linux admin experience including shell script development (Not essential).
• Exposure to AI or Data modelling development.
• Experience working on OLTP systems.
• Experience working on large and complex datasets.
• Understanding and application of Big Data and distributed computing principles (Azure Data Lake, Azure Databricks, Azure Synapse Analytics, Azure HDInsight and Azure Synapse Analytics).
• Data and ML model optimization skills in a production environment.
• Production environment machine learning and AI (advantageous).
• DevOps / DataOps and CI/CD experience (essential).
• AWS experience (advantageous).

The role entails building a reusable sustainable framework to ensure collection, processing, and availability of high-quality health care data to enable us to achieve the core purpose. The Data Engineer will work collaboratively with the Program Managers, Data Scientists, Systems Architects to define data sources and to build a custom data framework that facilitates Machine Learning, AI and productionising AI models based on the principles of ETL/ELT. Together these teams will enable data driven actionable insights.