Data Engineer at Astek Middle East
Dubai, Dubai, United Arab Emirates -
Full Time


Start Date

Immediate

Expiry Date

09 Feb, 27

Salary

25000.0

Posted On

11 Nov, 26

Experience

10 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Yes

Skills

Industry

Information Technology & Services

Description
  • Key Responsibilities1. Data Ingestion & IntegrationDesign, develop, and maintain scalable data ingestion pipelines using Azure Data Factory (ADF).
  • Integrate data from multiple sources, including SAP systems, relational databases, REST APIs, flat files, and cloud applications.
  • Implement incremental data loading and Change Data Capture (CDC) mechanisms.
  • Monitor, troubleshoot, and resolve data integration and pipeline-related issues.
  • 2. Data Transformation & ProcessingDevelop and maintain data transformation workflows using PySpark and SQL within Azure Databricks.
  • Implement and manage the Medallion Architecture (Bronze, Silver, and Gold layers).
  • Perform data cleansing, validation, enrichment, and transformation to meet business requirements.
  • Optimize data processing jobs for performance, scalability, and cost efficiency.
  • Work with Delta Lake to manage reliable and efficient data processing.
  • 3. Data Warehousing & ModelingSupport the implementation of enterprise data models and Common Data Models (CDM).
  • Develop curated and structured datasets for reporting and analytics.
  • Apply data warehousing and dimensional modeling principles.
  • Ensure data consistency, accuracy, and reliability across multiple business domains.
  • 4. Analytics EnablementDeliver trusted and optimized datasets for Power BI reporting and self-service analytics.
  • Collaborate with Business Analysts, BI Developers, and Data Architects to understand business and technical requirements.
  • Support improvements in reporting and dashboard performance.
  • 5. Data Governance & QualityImplement data quality checks, validation rules, and monitoring frameworks.
  • Ensure compliance with data governance standards and security policies.
  • Document data flows, business rules, and technical processes.
  • 6. Production Support & OperationsMonitor scheduled jobs, workflows, and data pipelines.
  • Investigate and resolve production incidents and data processing failures.
  • Perform root cause analysis and implement corrective actions.
  • Participate in deployment, release management, and CI/CD activities.


How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities
Loading...