Sr. Data Engineer

at  Dematic Ltd

We are seeking a dynamic and highly skilled Senior Data Engineer who has extensive experience building self -service enterprise scale data platforms with microservices architecture and lead these foundational efforts. This role demands someone who not only possesses a profound understanding of the data engineering landscape but also has a very strong software engineering background specially building microservices frameworks and architectures. The ideal candidate will be an individual contributor as well as the technical lead and contribute significantly to platform development and actively shape our data ecosystem.

THIS IS WHAT YOU WILL DO IN THIS ROLE:

• As a senior engineer, you will be responsible for ideation, architecture, design and development of our enterprise data platform.
• Architect and design core components with a microservices architecture, abstracting platform, and infrastructure intricacies.
• Create and maintain essential data platform SDKs and libraries, adhering to industry best practices.
• Design and develop connector frameworks and modern connectors to source data from disparate systems both on-prem and cloud.
• Design and optimize data storage, processing, and querying performance for large-scale datasets using industry best practices while keeping costs in check.
• Design and develop data quality frameworks and processes to ensure the accuracy and reliability of data.
• Design and develop microservices based semantic layer and metadata management components.
• Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions.
• Design and develop advanced analytics and machine learning capabilities on the data platform.
• Design and develop observability and data governance frameworks and practices.
• Stay up to date with the latest data engineering trends, technologies, and best practices.
• Drive the deployment and release cycles, ensuring a robust and scalable platform.