Solve challenging problems, using python coding skills.
Design, build and launch new data extraction, transformation & loading processes in production.
Web crawling, data cleaning, data annotation, data ingestion and data processing.
Reading and collating complex data sets.
Creating and maintaining data pipelines.
Continual focus on process improvement to drive efficiency and productivity within the team.
Use of Python, SQL, ES, Shell etc. to build the infrastructure required for optimal extraction, transformation, and loading of data.
Provide insights into key business performance metrics by building analytical tools that utilize the data pipeline.
Support the wider business with their data needs on an ad hoc basis.
Comply with QHSE (Quality Health Safety and Environment), Business Continuity, Information Security, Privacy, Risk, Compliance Management and Governance of Organizations policies, procedures, plans and related risk assessments.