Key Responsibilities

• Design and implement scalable data pipelines using Delta Live Tables (DLT), Spark SQL, Python, or Scala
• Optimize ETL, streaming, and ML workloads for performance, cost efficiency, and reliability
• Administer and configure Databricks Workspaces, Unity Catalog, and cluster policies for secure, governed environments
• Automate infrastructure and deployments using Terraform, Git, and CI/CD pipelines
• Implement observability, cost optimization, and monitoring frameworks using tools like Splunk, Prometheus, or CloudWatch
• Collaborate with customers to build AI and LLM solutions leveraging MLflow, DBRX, and Mosaic AI
•