Senior Technical Product Manager Token Factory - Inference at Nebius

, , United States -

Full Time

Start Date

Immediate

Expiry Date

16 Feb, 26

Salary

0.0

Posted On

18 Nov, 25

Experience

2 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Product Management, Cloud Infrastructure, Machine Learning, Technical Communication, Inference Workflows, Distributed Systems, Performance Optimization, Customer Engagement, Real-Time Systems, Batch Inference, ML Tools, Model Deployment, Scalability, Collaboration, AI, Engineering

Industry

technology;Information and Internet

Description

Why work at Nebius Nebius is leading a new era in cloud computing to serve the global AI economy. We create the tools and resources our customers need to solve real-world challenges and transform industries, without massive infrastructure costs or the need to build large in-house AI/ML teams. Our employees work at the cutting edge of AI cloud infrastructure alongside some of the most experienced and innovative leaders and engineers in the field. Where we work Headquartered in Amsterdam and listed on Nasdaq, Nebius has a global footprint with R&D hubs across Europe, North America, and Israel. The team of over 800 employees includes more than 400 highly skilled engineers with deep expertise across hardware and software engineering, as well as an in-house AI R&D team. The role In this role, you will lead the definition, development, and delivery of Nebius Token Factory’s inference capabilities, focusing on highly scalable, production-grade machine learning systems. You will be responsible for shaping the direction of our inference platform, driving product decisions that balance performance, reliability, and real-world customer needs. This includes working closely with engineering and research teams to design and optimize real-time and batch inference workflows, supporting customer PoCs, and translating technical challenges into clear product requirements. You will work directly with customers and internal stakeholders to understand ML workflows at scale, identify bottlenecks, and define features that improve latency, throughput, orchestration, and deployment efficiency. You will also guide product adoption by delivering intuitive tools and robust infrastructure that solve complex inference problems across diverse use cases. This role requires a strong technical foundation in ML systems and a product mindset oriented toward execution, clarity, and long-term scalability. You are welcome to work remotely from the US. Your responsibilities will include: Own the product roadmap for Nebius Token Factory inference capabilities, focusing on high-load, production-grade ML scenarios. Be involved in customer PoCs involving distributed ML model deployment, inference orchestration, and optimization. Work closely with engineering and research teams to shape scalable infrastructure for real-time and batch inference. Act as the technical voice in customer conversations, translating ML workflows into product requirements. Drive product adoption by delivering tools and features that solve real-world inference problems at scale. We expect you to have: 3–5 years of product management experience, ideally in cloud infrastructure, ML platforms, or developer tools. Strong technical foundation (e.g. Computer Science or Engineering degree) with ability to dive deep into model architectures and serving systems. Familiarity with modern ML inference tools and frameworks (e.g., Triton Inference Server, vLLM, SGLang, TensorRT-LLM, Dynamo, KServe, Ray Serve). Proven track record of delivering technically complex products that support distributed and high-throughput ML pipelines. Strong communicator with experience working across engineering, research, and customer-facing teams. It will be an added bonus if you have: Deep understanding of modern ML architectures, including transformer-based models and their inference characteristics. Experience delivering or supporting ML solutions in production as part of a customer-facing or solutions role. Knowledge of MLOps or AIOps cycles, including observability, performance optimization, and continuous delivery of ML systems. What we offer Competitive salary and comprehensive benefits package. Opportunities for professional growth within Nebius. Flexible working arrangements. A dynamic and collaborative work environment that values initiative and innovation. We’re growing and expanding our products every day. If you’re up to the challenge and are excited about AI and ML as much as we are, join us!

Responsibilities

You will lead the definition, development, and delivery of Nebius Token Factory’s inference capabilities, focusing on highly scalable, production-grade machine learning systems. This includes working closely with engineering and research teams to design and optimize real-time and batch inference workflows.