ETL Data Engineer at Lumiq

Noida, Uttar Pradesh, India -

Full Time

Start Date

Immediate

Expiry Date

26 Sep, 26

Salary

0.0

Posted On

28 Jun, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Python, Pandas, NumPy, Polars, SQL, PostgreSQL, Elasticsearch, MongoDB, Docker, Kubernetes, ETL Pipeline Design, Data Migration, Performance Optimization, Distributed Data Systems, Data Integrity, Containerization

Industry

Data Infrastructure and Analytics

Description

Who we are: LUMIQ is the leading Data and Analytics company in the Financial Services and Insurance (FSI) industry. We are trusted by the world's largest FSIs, including insurers, banks, AMCs, and NBFCs, to address their data challenges. Our clients include 40+ enterprises with over $10B in deposits/AUM, collectively representing about 1B customers globally. Our expertise lies in creating next-gen data technology products to help FSI enterprises organize, manage, and effectively use data. We have consistently challenged the status quo, introducing many industry-firsts like the first enterprise data platform in Asia on cloud for a regulated entity. Founded in 2013, LUMIQ has now completed a decade of innovation, backed by Info Edge Ventures (a JV between Temasek Holdings of Singapore and Naukri) and US-based Season 2 Ventures. Our Culture: At LUMIQ, we strive to create a community of passionate data professionals who aim to transcend the usual corporate dynamics. We offer you the freedom to ideate, commit, and navigate your career trajectory at your own pace. Culture of ownership empowerment to drive outcomes. Our culture encourages 'Tech Poetry' combining creativity and technology to create solutions that revolutionize industry. We trust our people to manage their responsibilities with minimal policy constraints. Our team is composed of the industry's brightest minds, from PhDs and engineers to industry specialists from Banking, Insurance, NBFCs, AMCs, who will challenge and inspire you to reach new heights. Role: We are seeking a highly skilled ETL Data Engineer to re-engineer our existing data pipelines to extract data from a new data source (PostgreSQL / CURA system) instead of the current Microsoft SQL Server (CRM persistence store), while preserving the existing load patterns to Elasticsearch and MongoDB. The engineer will ensure this migration has zero impact on data quality, system performance, or end-user experience. Key Responsibilities Analyze existing ETL pipelines and their dependencies on Microsoft SQL Server as source systems. Design and implement modifications to repoint ETL extractions from PostgreSQL (CURA) while preserving the current transformations and load logic into Elasticsearch and MongoDB. Ensure end-to-end data integrity, quality, and freshness remain unaffected after the source switch. Write efficient and optimized SQL queries to extract data from the new source. Conduct performance testing to confirm no degradation of pipeline throughput or latency in production. Work closely with DevOps and platform teams to containerize, orchestrate, and deploy the updated ETLs using Docker and Kubernetes. Monitor post-deployment performance and handle any production issues proactively. Document design, code, data mappings, and operational runbooks. Required Skills and Qualifications Strong experience building and maintaining large-scale distributed data systems. Expert-level proficiency in Python, especially data analysis/manipulation libraries like pandas, NumPy, and Polars. Advanced SQL development skills with proven experience in performance optimization. Working knowledge of Docker and Kubernetes. Familiarity with Elasticsearch and MongoDB as data stores. Experience working in production environments with mission-critical systems. What Do You Get: Opportunity to contribute to an entrepreneurial culture and exposure to the startup hustler culture. Competitive Salary Packages.Group Medical Policies. Equal Employment Opportunity. Maternity Leave. Opportunities for upskilling and exposure to the latest technologies. 100% Sponsorship for certification

Responsibilities

Re-engineer existing ETL pipelines to migrate data extraction from Microsoft SQL Server to PostgreSQL while maintaining loads to Elasticsearch and MongoDB. Ensure zero impact on data quality, system performance, and end-user experience during the transition.