Sign up to Y-Axis Job Site

Sign up with

Please choose a username.

Use this as Whatsapp number

I accept the Terms & Conditions

Already have an account? Log in here

Need some help?
Talk to us at +91 7670800001

Big Data Lead at HEXAWARE

, , India -

Full Time

Start Date

Immediate

Expiry Date

02 Sep, 26

Salary

0.0

Posted On

04 Jun, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Databricks, PySpark, SQL, AWS S3, AWS Glue, Kafka, CI/CD, DevOps, Data Governance, Data Lineage, Spark Optimization, ETL/ELT Pipelines

Industry

IT Services and IT Consulting

Description

Domain Expertise – Clinical research Data (Good to have) · Develop / Build high-performance and maintain ETL/ELT pipelines using Databricks (PySpark, SQL, Notebooks). Hands on development of Batch and incremental pipelines, streaming pipelines (Kafka, etc) Ensure high code quality and reusability · Proficiency in AWS (S3, Glue) · Perform advanced Spark optimization and cluster sizing · Implement CI/CD, version control, and DevOps best practices within Databricks. · Execute and Maintain data governance framework, scripts and Data lineage reports & Data Quality reports · Perform Technical Tests before UAT and provide sign-off (Bronze layer) · Plan and execute sprint deliveries · Review code, enforce standards · Act as the primary technical point of contact for delivery

Responsibilities

Lead the development and maintenance of high-performance ETL/ELT and streaming pipelines using Databricks and AWS. Act as the primary technical point of contact for delivery, overseeing code reviews, sprint planning, and data governance.