Data Engineer - ETL/PySpark
at
I-SOFT GLOBAL SOFTWARE SOLUTIONS
Dubai, Dubai, United Arab Emirates
-
Full Time
Start Date
Immediate
Expiry Date
11 Nov, 26
Salary
0.0
Posted On
01 Sep, 26
Experience
0 year(s) or above
Remote Job
Yes
Telecommute
Yes
Sponsor Visa
No
Skills
Industry
Information Technology & Services
Description
Responsibilities:
Solve challenging problems, using python coding skills.
Design, build and launch new data extraction, transformation & loading processes in production.
Web crawling, data cleaning, data annotation, data ingestion and data processing.
Reading and collating complex data sets.
Creating and maintaining data pipelines.
Continual focus on process improvement to drive efficiency and productivity within the team.
Use of Python, SQL, ES, Shell etc. to build the infrastructure required for optimal extraction, transformation, and loading of data.
Provide insights into key business performance metrics by building analytical tools that utilize the data pipeline.
Support the wider business with their data needs on an ad hoc basis.
Comply with QHSE (Quality Health Safety and Environment), Business Continuity, Information Security, Privacy, Risk, Compliance Management and Governance of Organizations policies, procedures, plans and related risk assessments.