Staff Product Analyst - Agentic AI Tracking at Delivery Hero

Berlin, , Germany -

Full Time

Start Date

Immediate

Expiry Date

11 Jan, 26

Salary

0.0

Posted On

13 Oct, 25

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Product Analyst, Data Analyst, Agentic AI Systems, LLM Orchestration, AI Evaluation Frameworks, Event Tracking Tools, Logging Frameworks, Observability Practices, SQL, Data Visualization, Data Validation, Debugging Techniques, Communication Skills, Collaboration Skills, Python, Data Pipelines

Industry

technology;Information and Internet

Description

Company Description As the world’s pioneering local delivery platform, our mission is to deliver an amazing experience, fast, easy, and to your door. We operate in over 70+ countries worldwide, powered by tech, designed by people. As one of Europe’s largest tech platforms, headquartered in Berlin, Germany. Delivery Hero has been listed on the Frankfurt Stock Exchange since 2017 and is part of the MDAX stock market index. We enable creative minds to deliver solutions that create impact within our ecosystem. We move fast, take action and adapt. No matter where you're from or what you believe in, we build, we deliver, we lead. We are Delivery Hero. Job Description We are seeking a dedicated and detail-oriented Staff Product Analyst to join our Vendor Team on our journey to always deliver amazing experiences. As part of our Vendor Team, you’ll be the driving force behind the success of thousands of restaurants, shops, and local businesses. Your contributions will empower vendors with advanced tools to manage their operations, boosting their visibility and reach. Every feature you help build will create growth opportunities for businesses of all sizes, strengthening Delivery Hero’s ecosystem and impact. As a Staff Product Analyst, you will collaborate closely with AI Research, Data Science, Product Analytics, and Engineering teams to ensure our tracking infrastructure captures the right signals and produces high-quality, actionable insights. Your work will empower stakeholders to analyze agent behavior, measure the impact of new agentic features, and support the development of scalable evaluation pipelines. What you need to be successful: Collaborate with Product and Engineering to define, implement, and document tracking requirements for agent actions, state transitions, and user-agent interactions. Develop and maintain monitoring systems, dashboards, and alerts to ensure correctness and completeness of agentic interaction data. Investigate anomalies in agent event logs, trace data discrepancies, and drive timely resolutions. Partner with AI Research and Data Science teams to ensure tracking aligns with evaluation metrics, model training needs, and simulation goals. Collaborate with Product Analytics to validate interaction data for user behavior analysis, feature assessment, and agent success metrics. Create and maintain comprehensive documentation for agent tracking specifications, data validation procedures, and QA frameworks. Identify and implement process improvements to enhance the robustness, reliability, and scalability of agent data collection pipelines. Qualifications Proven experience in a similar role (e.g., Product Analyst, Data Analyst, or related position). Familiarity with agentic AI systems, LLM orchestration, or AI evaluation frameworks. Strong understanding of event tracking tools, logging frameworks, and observability practices (experience with structured event tracking, OpenTelemetry, or custom agent logging preferred). Proficiency in SQL and data visualization platforms (e.g., Looker, Tableau, Power BI). Knowledge of data validation, debugging, and monitoring techniques. Excellent communication and collaboration skills, with the ability to translate technical concepts for non-technical stakeholders. Preferred Experience with Python for data analysis, scripting, and log parsing. Background in data pipelines, ETL processes, or real-time event streaming (Kafka, Pub/Sub, etc.). Prior experience working closely with AI or ML teams to validate data for model training or evaluation. What's in it for you? Ensuring you and all our Heroes are looked after, happy, and healthy is always on the menu. Because if you’re in good shape, then we’re in good shape. Make the most of our hybrid working model and join the team for face-to-face connection and collaboration in our beautiful Berlin campus 2 days a week We offer 27 days holiday with an extra day on 2nd and 3rd year of service We will support you in developing yourself and your career growth opportunities: 1.000 € Educational Budget, Language Courses, Parental Support and access to the Udemy Business platform to explore a variety of online courses. Get moving and release those wonderful, mind-boosting endorphins: Health Checkups, Meditation, Gym & Bicycle Subsidy Cash. Dough. Cheddar. Whatever you call it, we’ll help you with it: Employee Share Purchase Plan, Sabbatical Bank, Public Transportation Ticket Discount, Life & Accident Insurance, Corporate Pension Plan The power of getting together over some food is unrivaled. Here are a few ways to help you do that. All the yum: Digital Meal Vouchers, Food Vouchers, Corporate Discounts. Courses. Ready to join our team? If you’re excited to grow, collaborate and be part of the world’s leading delivery platform, we’d love to hear from you. Apply today! Additional Information We believe diversity and inclusion are key to creating not only an exciting product, but also an amazing customer and employee experience. Fostering this starts with hiring - therefore we do not discriminate on the basis of racial identities, religious beliefs, color, national origin, gender identities or expressions, sexual orientations, age, marital or disability statuses, or any other aspect that makes you, you. We encourage you to let us know if you need any accommodations or specific accessibility support to ensure a smooth interview experience—just include it in your application. You're welcome to share your pronouns (he/she/they) right from the start so we can address you respectfully from our first contact.

Responsibilities

As a Staff Product Analyst, you will collaborate with various teams to ensure our tracking infrastructure captures the right signals and produces actionable insights. Your work will empower stakeholders to analyze agent behavior and support the development of scalable evaluation pipelines.