Staff Software Engineer, Model Serving

Highlights

• Design core systems powering unified Model Serving for AI workloads.
• Shape product experience and foundational infrastructure at global scale.
• Lead initiatives improving latency, availability and cost efficiency.

What they offer

• Annual performance bonus
• Equity
• Comprehensive benefits

Ideal candidate

A seasoned distributed-systems leader with 10+ years building large-scale platforms who thrives on technical ownership, cross-functional collaboration, and mentoring engineers while aligning architecture with long-term product vision.

Requirements

• 10+ years of experience building and operating large-scale distributed systems
• Deep expertise in model serving, inference systems, and related infrastructure
• Strong foundation in algorithms, data structures, and system design
• Proven ability to deliver technically complex, high-impact initiatives
• Experience leading architecture for large-scale CPU/GPU inference systems
• Strong communication skills and ability to collaborate across teams
• Strategic and product-oriented mindset
• Passion for mentoring engineers and fostering technical excellence