Staff Software Engineer, Inference Cloud

Highlights

• Own major areas of Inference Cloud architecture behind ultra-fast AI service.
• Design multi-region traffic, routing and failover for global-scale inference.
• Build systems delivering 10x faster inference than GPU hyperscale clouds.

Ideal candidate

Seasoned distributed-systems builder who thrives on high-scale, latency-sensitive challenges and owns critical architecture end-to-end. You lead through technical depth, operational rigor, and calm production leadership.

Requirements

• 8+ years of experience in software engineering, with substantial individual contributor experience building and operating large-scale distributed systems or cloud infrastructure.
• Deep expertise in distributed systems architecture in cloud environments, including networking, compute orchestration, container platforms, and multi-region production services.
• Strong track record of making sound architectural decisions for highly available, latency-sensitive systems at scale.
• Experience optimizing latency, throughput, and efficiency in high-QPS systems.
• Strong proficiency in backend or systems languages such as Go, C++, or Python, with ability to contribute production code directly.
• Experience designing observability and reliability practices, including metrics, logging, tracing, alerting, incident response, and SLO-driven operations.
• Ability to influence senior engineers and cross-functional partners through technical credibility, communication, and judgment.