Software Engineer, Distributed Systems

Highlights

• Build core inference platform handling routing, orchestration, and GPU autoscaling.
• Design systems to scale 100x current traffic with low latency worldwide.
• Tune low-level performance to power next-gen generative media products.

What they offer

• Equity
• Health, dental, and vision insurance (US)
• Relocation assistance to San Francisco
• Regular team events and offsites
• Learning and growth opportunities

Ideal candidate

Experienced platform engineer who thrives on complex, high-traffic systems and owns end-to-end reliability. Self-starter who moves fast, communicates clearly, and uses AI to automate the mundane.

Requirements

• 3+ years experience building distributed compute and orchestration platforms in Python or Rust
• Strong understanding of distributed systems fundamentals: consensus, scheduling, fault tolerance, capacity planning
• Deep understanding of computational complexity and memory allocation
• Track record of designing systems that scale under real production load
• Experience building and using observability to drive performance and reliability decisions
• Excellent communication and ability to drive technical decisions across teams
• Self-starter who executes quickly, takes ownership, and constantly seeks improvement
• Experience with AI/ML inference or training infrastructure
• Experience with high-performance systems programming (async runtimes, zero-copy, memory-safe concurrency)
• Background in building multi-tenant compute platforms
• Understanding of networking fundamentals and performance characteristics
• Familiarity with GPU workload characteristics and scheduling constraints