Product Manager, Inference Experience

Highlights

• Own inference experience from model discovery to production at scale.
• Shape Model APIs, Dedicated Inference, Evaluations and Model Library.
• Turn inference performance breakthroughs into developer-loved products.

What they offer

• Meaningful equity (U.S. only)
• 100% medical, dental, and vision coverage for employee and dependents
• Flexible PTO including Winter Break closure
• Paid parental leave
• Fertility and family-building stipend through Carrot (U.S. only)
• Company-facilitated 401(k)

Ideal candidate

Experienced AI product builder with strong technical judgment and taste for developer experience, who loves turning complex infrastructure into simple, adoptable products alongside engineers and customers.

Requirements

• 10+ years building and shipping AI/ML products or platforms
• Technical background in software engineering, ML engineering, research, or equivalent hands-on experience
• Direct experience building or deploying models using PyTorch, TensorRT-LLM, vLLM, SGLang, NVIDIA Dynamo or similar
• Strong understanding of model serving, GPU economics, and tradeoffs between quality, latency, throughput, and cost
• Exceptional developer product instincts for making complex technology approachable without sacrificing power
• Track record leading cross-functional product initiatives driving measurable adoption or revenue growth