Sr. Staff Software Engineer, Inference Platform

Highlights

• Build orchestration layer powering ultra-fast inference on datacenter clusters.
• Architect active-active systems with rapid failover and clear SLOs.
• Shape next-generation globally distributed inference platform architecture.

What they offer

• Build a breakthrough AI platform beyond the constraints of the GPU
• Publish and open source cutting-edge AI research
• Work on one of the fastest AI supercomputers in the world
• Job stability with startup vitality
• Simple, non-corporate work culture that respects individual beliefs

Ideal candidate

Seasoned backend builder who thrives operating large-scale distributed systems and leading through hard production challenges with high operational rigor and calm technical influence.

Requirements

• 8+ years in software engineering building and operating large-scale distributed systems or cloud infrastructure
• Deep expertise in distributed systems architecture, ideally with Kubernetes
• Track record of architectural decisions for highly available, latency-sensitive systems at scale
• Experience with security including certificates, TLS, mTLS
• Experience optimizing latency, throughput and efficiency in high-QPS systems
• Strong proficiency in backend or systems languages such as Go or C++ with direct production contribution
• Experience designing observability and reliability practices including metrics, logging, tracing, alerting, incident response and SLOs
• Ability to influence senior engineers and cross-functional partners through technical credibility and judgment