Senior Data Engineer at Endava

Pune, maharashtra, India -

Full Time

Start Date

Immediate

Expiry Date

11 Mar, 26

Salary

0.0

Posted On

11 Dec, 25

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Python, MongoDB, Data Engineering, ETL, Data Modeling, Data Processing, Data Pipelines, Job Orchestration, API Integration, Agile Development, Data Quality, Data Security, Cloud Platforms, Streaming Technologies, Data Orchestration Tools, DevOps Practices

Industry

IT Services and IT Consulting

Description

Company Description Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change. By combining world-class engineering, industry expertise and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses. From prototype to real-world impact - be part of a global shift by doing work that matters. Job Description We are looking for an experienced Senior Data Engineer to design, build, and optimize data pipelines, storage solutions, and data-driven systems within our technology organization. The ideal candidate has strong hands-on experience with Python and MongoDB, combined with a solid understanding of data modeling, data processing frameworks, and scalable data architectures. This role requires technical leadership, ownership of end-to-end data engineering tasks, and the ability to collaborate effectively within cross-functional teams. Key Responsibilities Design, develop, and maintain scalable data pipelines, ETL/ELT workflows, and data processing jobs using Python. Architect and optimize MongoDB databases, including data modeling, indexing, and performance tuning. Implement data ingestion, transformation, and integration solutions from diverse data sources. Ensure data quality, reliability, and consistency across systems through testing and validation. Collaborate with analytics, product, and engineering teams to support data requirements and deliver data-driven solutions. Develop automation for data workflows, monitoring, and error handling. Ensure adherence to data security, compliance, and governance best practices. Contribute to architecture decisions, performance optimization strategies, and continuous improvement initiatives. Mentor junior team members in data engineering best practices. Qualifications Required Skills & Qualifications 5–10 years of experience in Data Engineering or similar technical roles. Strong hands-on expertise with Python for data processing, automation, and application development. Deep experience with MongoDB, including schema design, aggregation pipelines, indexing strategies, and optimization. Solid understanding of data engineering fundamentals: ETL/ELT, data modeling, structured/unstructured data handling, and distributed systems concepts. Experience working with data pipelines, job orchestration tools, and workflow scheduling. Knowledge of API integration, data ingestion techniques, and handling high-volume datasets. Experience working in agile software development environments. Strong analytical, problem-solving, and communication skills. Preferred Qualifications Experience with cloud platforms (AWS, Azure, or GCP). Familiarity with streaming technologies (Kafka, Kinesis, Pulsar). Experience with data orchestration tools (Airflow, Prefect, Dagster). Knowledge of DevOps practices related to data engineering (CI/CD, containerization, monitoring). Additional Information At Endava, we’re committed to creating an open, inclusive, and respectful environment where everyone feels safe, valued, and empowered to be their best. We welcome applications from people of all backgrounds, experiences, and perspectives—because we know that inclusive teams help us deliver smarter, more innovative solutions for our customers. Hiring decisions are based on merit, skills, qualifications, and potential. If you need adjustments or support during the recruitment process, please let us know.

Responsibilities

The Senior Data Engineer will design, develop, and maintain scalable data pipelines and optimize MongoDB databases. They will also collaborate with cross-functional teams to support data requirements and ensure data quality and security.