Software Engineer - Inference Platform

Highlights

• Build distributed runtime powering large-scale LLM inference for top AI companies.
• Own Model APIs from deployment UX to orchestration and efficient traffic routing.
• Make every model fast, reliable, and cost-efficient at production scale.

What they offer

• Meaningful equity (U.S. only)
• 100% medical, dental, and vision coverage for employee and dependents
• Flexible PTO including company-wide Winter Break
• Paid parental leave
• Fertility and family-building stipend through Carrot
• Company-facilitated 401(k)

Ideal candidate

Product-minded distributed systems engineer who loves owning production systems end-to-end and making complex infrastructure simple, fast, and reliable for developers building with AI.

Requirements

• Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, or related field or equivalent experience
• 3+ years building and operating distributed systems, backend infrastructure, or large-scale APIs
• Proven track record owning low-latency, reliable backend services including rate limiting, auth, quotas and metering
• Strong infrastructure instincts for profiling, tracing, capacity planning and SLO management
• Comfort debugging performance and reliability issues across multiple layers of the stack
• Strong sense of developer experience and excellent written communication and collaboration skills