🛠️ What You’ll Be Doing:

• Build and maintain scalable batch, near-real-time, and real-time data pipelines.

• Develop production-grade pipelines using Kafka, Spark, Databricks, PySpark, and Airflow.

• Design and optimise data models and distributed processing workflows for high-volume datasets.

• Work closely with Data Science and Backend Engineering teams to support ML, recommendation, personalisation, and fraud detection initiatives.

• Improve testing, monitoring, reliability, and performance across production data systems.

• • Troubleshoot production issues and contribute to the ongoing stability and scalability of the data platform.