Software Engineer, Inference

Highlights

• Define Sierra's inference architecture across self-hosted and third-party models.
• Build routing, failover and capacity systems for real-time AI agents at scale.
• Operate GPU inference and push serving-stack performance with frontier labs.

What they offer

• Flexible (unlimited) paid time off
• Medical, dental, and vision benefits for you and your family
• Life insurance and disability benefits
• Parental leave
• Fertility and family building benefits through Carrot
• Lunch, snacks and coffee
• Discretionary benefit stipend
• Equity plans

Ideal candidate

Systems-minded engineer who loves large-scale distributed infrastructure and owns complex systems end-to-end. Excited to apply that craft to fast-moving AI inference, balancing latency, reliability and cost.

Requirements

• Deep systems thinking and strong distributed systems fundamentals
• Experience designing, building, and operating large-scale production systems
• Strong judgment around tradeoffs involving latency, reliability, capacity, and cost
• Experience taking ownership of complex infrastructure from architecture through production operation
• Excitement about applying systems expertise to AI infrastructure and learning quickly