Data Engineer at Venquis
Dubai, Dubai, United Arab Emirates -
Full Time


Start Date

Immediate

Expiry Date

01 Feb, 27

Salary

25000.0

Posted On

03 Nov, 26

Experience

10 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Yes

Skills

Industry

Information Technology & Services

Description
  • Key ResponsibilitiesData Ingestion Development
    • Build and implement AWS Glue jobs for Bronze layer ingestion using defined standards and templates.
    • Implement correct loading methods based on source requirements (CDC, full load, delta, snapshot).
    • Design and execute historical loading mechanisms to bring legacy data into the Lakehouse.
  • Performance Optimization
    • Optimize Glue job performance (DPU allocation, parallelization, partitioning) according to best practices.
    • Collaborate with platform teams to ensure tooling and optimization alignment.
  • Migration & Automation
    • Aggressively migrate source tables to Bronze layer, initially using manual approaches with standards/templates, later leveraging AI-enabled acceleration.
    • Ensure jobs are version-controlled and production deployment is automated via Git and Terraform.
  • Governance & Monitoring
    • Implement source system connectivity into CDP in collaboration with source system owners.
    • Ensure jobs comply with data contracts and are properly monitored.
    • Prepare documentation and handover to operational support teams.
  • Collaboration
    • Work closely with Data Architect for ingestion patterns and standards.
    • Coordinate with Data Assurance Lead to apply quality checks across all jobs.
    • Partner with platform engineers for tooling and optimization.

How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities
Loading...