Lead Azure Data Engineer at Weekday AI

Pune, maharashtra, India -

Full Time

Start Date

Immediate

Expiry Date

18 Sep, 26

Salary

2000000.0

Posted On

20 Jun, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Azure Data Factory, Databricks, Azure Synapse Analytics, Spark, PySpark, SQL, ETL/ELT Pipelines, Delta Lake, Data Modeling, CI/CD, DevOps, Data Governance, Cloud Architecture, Big Data Technologies, Data Warehousing, Data Lakes

Industry

technology;Information and Internet

Description

This role is for one of the Weekday's clients Salary range: Rs 500000 - Rs 2000000 (ie INR 5-20 LPA) Experience: 4+ yrs Location: Bengaluru, Pune, Hyderabad, NCR, Chennai Job Type: full-time We are seeking a Data Engineer / Senior Data Engineer to design, build, and optimize large-scale cloud-based data platforms that support business intelligence, analytics, and data-driven decision-making. This role focuses on developing modern data pipelines, data lakes, and warehouse solutions while working with real-time and batch processing systems in a cloud environment. You will collaborate with cross-functional teams to deliver scalable, high-quality data architectures that enable actionable insights across the organization. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines for processing large volumes of structured and unstructured data. Build and manage cloud-based data platforms, including data lakes, data warehouses, and analytics solutions. Develop and optimize data pipelines using Spark, PySpark, and cloud-native data services. Work with real-time and batch data processing frameworks to ensure reliable and efficient data delivery. Design robust data models and implement best practices for data quality, governance, and performance. Optimize SQL queries, database performance, and large-scale analytics workloads. Develop and maintain reporting and visualization solutions to support business stakeholders. Collaborate with business, engineering, analytics, and product teams to define data requirements and solutions. Support CI/CD processes, automation, monitoring, and deployment of data engineering solutions. Create technical documentation and ensure adherence to modern engineering and data management standards. What Makes You a Great Fit 7+ years of experience in Data Engineering, ETL development, and cloud-based analytics solutions. Strong expertise in Azure Data Factory, Databricks, Azure Synapse Analytics, Spark, and PySpark. Hands-on experience with data lakes, Delta Lake architecture, and modern big data technologies. Strong SQL development, query optimization, and performance tuning skills. Experience designing scalable cloud-hosted data platforms and enterprise-grade data architectures. Knowledge of reporting and analytics tools, including data modeling and dashboard development. Familiarity with CI/CD pipelines, DevOps practices, and cloud security concepts such as RBAC. Strong problem-solving, communication, and stakeholder management skills. Ability to translate business requirements into scalable technical data solutions while maintaining high standards of quality and reliability.

Responsibilities

Design, build, and optimize large-scale cloud-based data platforms and ETL/ELT pipelines to support business intelligence. Collaborate with cross-functional teams to deliver scalable data architectures and maintain reporting solutions.