Staff Software Engineer, Foundational Model Serving

Highlights

• Build high-throughput, low-latency inference APIs for frontier AI models.
• Shape product and core infrastructure for Foundation Model Serving at scale.
• Optimize GPU serving for throughput, autoscaling and operational efficiency.

What they offer

• Annual performance bonus
• Equity
• Comprehensive benefits and perks

Ideal candidate

A seasoned distributed systems leader who thrives owning operationally sensitive services and mentoring others. Product-minded and collaborative, excited to shape scalable LLM APIs and influence AI platform direction.

Requirements

• 10+ years building and operating large-scale distributed systems
• Experience leading high-scale operationally sensitive backend systems
• Strong foundation in algorithms, data structures and system design for low-latency serving
• Proven ability to deliver complex high-impact initiatives with measurable value
• Strong communication and cross-team collaboration in fast-moving environments
• Strategic product-oriented mindset aligning execution with long-term vision
• Passion for mentoring engineers and fostering technical excellence