Sign up to Y-Axis Job Site

Sign up with

Please choose a username.

Use this as Whatsapp number

I accept the Terms & Conditions

Already have an account? Log in here

Need some help?
Talk to us at +91 7670800001

Data Engineer at EXL Talent Acquisition Team

, , India -

Full Time

Start Date

Immediate

Expiry Date

19 Oct, 26

Salary

0.0

Posted On

21 Jul, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Databricks, Apache Spark, Delta Lake, Python, PySpark, SQL, Azure, ETL/ELT, CDC, SCD, CI/CD, DevOps, Lakehouse Architecture, Data Governance, Performance Tuning, Agile

Industry

Business Consulting and Services

Description

* Design, develop, and optimize data pipelines using Databricks, Apache Spark, and Delta Lake. * Implement data ingestion, transformation, and integration workflows for large-scale datasets. * Ensure data quality, reliability, and performance across all pipelines. * Collaborate with data architects and analysts to enable analytics and reporting capabilities. * Apply best practices for Lakehouse architecture and cloud-based data engineering. * Monitor and troubleshoot pipeline performance, ensuring scalability and efficiency. * Work within an Agile framework for sprint planning, backlog management, and continuous delivery.

Responsibilities

Design, develop, and optimize scalable data pipelines using Databricks, Apache Spark, and Delta Lake. Collaborate with architects and analysts to ensure data quality and enable reporting capabilities within an Agile framework.