Software Engineer, Inference

Highlights

• Own reliability and scale of production inference serving live traffic.
• Power Tinker's live multi-tenant serving platform for frontier models.
• Ship new models safely with incremental rollouts to production.

What they offer

• health, dental, and vision benefits
• unlimited PTO
• paid parental leave
• relocation support as needed

Ideal candidate

A systems-minded engineer who thrives owning critical production systems and staying calm in incidents. You care about reliability at scale and bridging research breakthroughs to dependable real-world serving.

Requirements

• Experience operating large-scale, latency-sensitive production systems
• Proficiency in Python and Go or another systems language
• Experience with observability, monitoring, and incident response for production services
• Strong understanding of distributed systems and how they fail at scale
• Experience running production inference for large language models or other large-scale ML systems
• Experience with deployment and rollout systems, such as canarying, blue/green deploys, or feature flags
• Experience with capacity planning and cost optimization for GPU or TPU infrastructure
• Familiarity with inference-specific techniques, such as batching, caching, or quantization, and their operational implications
• Comfortable being on-call and leading incident response for critical production systems
• Comfortable working with high autonomy in a fast-changing, early-stage environment