Staff Product Manager, AI Inference

Highlights

• Lead strategy for cutting-edge AI inference services at AI hyperscaler.
• Own roadmap for scalable AI cloud services for foundation models.
• Solve novel scaling challenges for AI inference on specialized hardware.

What they offer

• Tuition reimbursement
• Employee Stock Purchase Program (ESPP)
• Mental wellness benefits through Spring Health
• Family-forming support, paid parental leave and childcare support
• 401(k) with generous employer match
• Flexible PTO
• Catered daily lunch

Ideal candidate

A passionate AI and cloud product leader who thrives in ambiguity, stays close to customers, and unites engineering and go-to-market teams to build differentiated inference services.

Requirements

• 8+ years in product management with 5+ years in cloud services or AI/ML
• Deep understanding of foundation model inference, inference engines and optimization techniques
• Knowledge of GPU cloud infrastructure and cloud-native architectures like Kubernetes and microservices
• Proven ability to lead cross-functional teams with strong decision-making and mentoring skills
• Experience working closely with customers to translate needs into product features