Senior Software Engineer I, Inference

Highlights

• Own inference areas that serve leading AI labs at massive scale.
• Deliver measurable gains in latency, throughput and reliability.
• Lead designs meeting strict P99 SLAs for Essential Cloud for AI.

What they offer

• Tuition Reimbursement
• Employee Stock Purchase Program (ESPP)
• Mental Wellness Benefits through Spring Health
• Family-forming support through Carrot
• Paid Parental Leave
• Flexible childcare support with Kinside
• 401(k) with generous employer match
• Flexible PTO
• Catered lunch daily in office and data center locations

Ideal candidate

Area owner with years building distributed systems who obsesses over tail latency and reliability. Curious, ownership-minded mentor who thrives in hyper-growth chaos and cross-team collaboration.

Requirements

• 3-5 years (IC3) or 5-8 years (IC4) building distributed systems or cloud services
• Strong coding in Python or Go (C++ a plus) with deep networked systems performance focus
• Hands-on Kubernetes at production scale, CI/CD and observability (Prometheus, Grafana, OpenTelemetry)
• Practical knowledge of inference internals: batching, caching, mixed precision and streaming delivery
• Proven track record improving tail latency (P95/P99) and reliability through metrics-driven work
• Bachelor's or Master's in CS, EE or related field or equivalent practical experience