Product Manager II - LLM Evaluations

at  DataDog

We are seeking a highly motivated and experienced Product Manager to lead our new Large Language Model Observability product. This is an exciting opportunity to shape the future of observability in a dynamic and innovative environment in a nascent market.
As the Product Manager for LLM Observability, you will work with engineers and designers to build a product that our customers love and will use everyday to monitor and understand how well their LLM-based applications are working. We are looking for a passionate, hands-on product manager who will dive into conversations with customers, deeply understand their daily workflows and pains and ship a product that is integral to their daily workflows for monitoring and troubleshooting AI/ML model performance. Working with this team is an opportunity to drive impact in the rapidly growing field of AI evaluations and collaborating with the best Applied Scientists in the industry.
At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.

• Lead the development and execution of the roadmap for a large portion of our LLM Observability product
• Work closely with engineers and designers to define the product feature, functionality as well as requirements for backend systems and user experience
• Run beta programs with customers collecting feedback on the feature, functionality and usability of the core product offering
• Partner with our AI research team and applied scientists to conceptualize, test and productize new ideas
• Breakdown complexity and ambiguity into prioritized set of problems for Engineering to solve
• Responsible for taking this product to the public, including sales and marketing enablement in partnership with marketing teams
• Use your understanding of ML/AI or a relevant technical space understand end user workflows and translate that into product and design requirements