Key responsibilities:

• Collaborate within a scrum team to prepare, structure, enrich, and validate enterprise data for AI knowledge bases and AI Chatbots.
• Build and maintain data pipelines in Databricks to process structured and unstructured data for AI knowledge bases.
• Apply evaluation frameworks to test advanced chatbots across single-turn, multi-turn, simulation-based, and agentic scenarios.
• Prepare, clean, transform, and enrich source data to improve the quality and reliability of information used by AI assistants.
• Create and maintain evaluation datasets covering realistic conversations, complex cases, edge cases, and multi-step workflows.
• Implement automated testing, monitoring, and quality gates for changes to data, prompts, models, retrieval, and orchestration.
• Deploy and manage cloud infrastructure using Infrastructure as Code, particularly Azure Bicep and CI/CD pipelines.
• Analyse evaluation results and translate findings into improvements across knowledge, retrieval, prompts, tools, and application logic.