Senior Databricks Data Engineer - Contract-to-Hire at Customized Energy Solutions

Pune, maharashtra, India -

Full Time

Start Date

Immediate

Expiry Date

13 May, 26

Salary

0.0

Posted On

12 Feb, 26

Experience

10 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Databricks, Data Engineering, SQL, PySpark, ETL, Data Warehousing, Data Governance, Spark, Cloud Platforms, Data Modeling, Data Pipelines, Analytics, AI/ML, CI/CD, Delta Lake, Lakehouse

Industry

Utilities

Description

Company Description Customized Energy Solutions India Pvt. Ltd. (CES India) is part of Customized Energy Solutions (CES), a globally recognized, privately held energy market intelligence, consulting, and operational services firm supporting retail and wholesale electricity and natural gas markets worldwide. Headquartered in Philadelphia, CES operates across the United States, Canada, Japan, India, and Vietnam, with approximately 400 associates globally. The company has earned multiple distinctions from INC. 500 | 5000 and the Philadelphia Business Journal, including Hall of Fame status and repeated recognition as a Best Place to Work. Established in 2010, CES India plays a critical role in supporting both domestic and international energy initiatives. The India team brings expertise in emerging technologies transforming the energy landscape, including energy storage, electric mobility, wholesale electricity markets, microgrids, and renewable energy systems. Associates in India collaborate closely with global teams while contributing deep technical and analytical capabilities to complex energy market challenges. CES India actively engages with industry bodies and ecosystem partners that are shaping India’s energy and technology landscape, including organizations such as the India Electronics and Semiconductor Association (IESA). Through industry collaboration, technology innovation, and engagement with public and private stakeholders, CES India supports the broader goal of advancing sustainable, high-growth energy and manufacturing sectors in India. At CES India, you will work in a fast-evolving industry where innovation, accountability, and professional growth are valued. Your work will contribute to meaningful outcomes across both regional and global energy markets. At CES, your work matters — and your expertise makes a measurable impact. Job Description We are seeking a Senior Databricks Data Engineer to provide technical leadership on a major data platform transformation initiative. This role will lead and execute the migration of a large-scale Microsoft SQL Server data warehouse ecosystem—including SSIS, SSAS, and SSRS—onto the Databricks Lakehouse Platform. The ideal candidate combines deep hands-on data engineering expertise with architectural thinking and mentorship capabilities. Key Responsibilities Lead the design and implementation of enterprise-scale data pipelines on Databricks. Serve as a technical lead for the migration of a ~20TB SQL Server data warehouse to Databricks. Architect migration strategies for hundreds of tables, thousands of SSIS jobs, and complex reporting workloads. Redesign legacy ETL and cube-based architectures into modern Lakehouse patterns. Define data modeling standards, ingestion frameworks, and transformation best practices. Optimize Spark workloads for performance, scalability, and cost efficiency. Mentor and guide data engineers across multiple experience levels. Partner with BI, analytics, and AI/ML teams to enable advanced analytics use cases. Implement data governance, security, lineage, and monitoring using Unity Catalog and platform tooling. Translate business requirements into scalable technical solutions. Influence platform roadmap, engineering standards, and architectural decisions. Qualifications Bachelor’s or Master’s degree in Computer Science, Engineering, or related field. 8–12 years of overall data engineering experience. 5+ years of hands-on experience building production workloads on Databricks. Deep expertise in SQL, PySpark, and distributed data processing. Proven leadership in migrating enterprise SQL Server data warehouses to cloud platforms. Strong experience replacing SSIS-based ETL with modern Spark-based pipelines. Solid understanding of SSAS cube architectures and modernization approaches. Experience designing highly reliable, high-volume analytical data platforms. Strong knowledge of Delta Lake, Lakehouse and Medallion architectures, data versioning, and Workflows/Jobs orchestration. Experience implementing CI/CD, testing, and operational best practices for data pipelines. Primary experience with AWS-based data platforms strongly preferred. Preferred Skills Experience designing semantic layers and BI integrations (Power BI preferred). Exposure to Databricks AI/ML capabilities such as MLflow and feature stores. Experience operating in environments aligned with Databricks-recommended engineering patterns. Databricks certification is a plus. Prior technical leadership experience in distributed or global teams. Strong communication and stakeholder engagement skills. Additional Information Customized Energy Solutions India offers competitive compensation commensurate with experience, along with performance-based incentives aligned to individual and company results. Our benefits are designed to support both professional and personal well-being and include comprehensive medical insurance coverage for associates and eligible dependents, generous paid time off, and structured opportunities for professional development through training programs and skill enhancement initiatives. We are committed to creating an environment where associates are supported, challenged, and positioned for long-term career growth. At CES, you will gain: Meaningful responsibility and the opportunity to make a real impact in dynamic energy markets The chance to learn from and collaborate with experienced professionals across global teams Ongoing opportunities to strengthen your technical, analytical, and leadership skills A supportive culture that values initiative, accountability, and continuous professional growth Customized Energy Solutions provides equal employment opportunities to all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Responsibilities

Lead the design and implementation of enterprise-scale data pipelines on Databricks and serve as a technical lead for migrating a large SQL Server data warehouse to Databricks. Mentor and guide data engineers while partnering with BI, analytics, and AI/ML teams to enable advanced analytics use cases.