Associate Director/Director, Inference Engineering

Highlights

• Own the inference service end to end bringing models reliably to production.
• Define how Lila serves models at scale balancing speed, quality and cost.
• Build systems for model onboarding, deployment safety and observability.

What they offer

• Competitive base compensation with bonus potential and generous early-stage equity
• Medical, dental, and vision coverage
• Employer-paid life and disability insurance
• Flexible time off with generous company wide holidays
• Paid parental leave
• Educational assistance program
• Commuter benefits, including bike share memberships
• Company subsidized lunch program

Ideal candidate

A technical leader who thrives owning production services and mentoring senior engineers. You balance research ambition with reliability, and love turning cutting-edge models into dependable products.

Requirements

• Deep understanding of the inference stack for large language models, including serving frameworks, batching, memory constraints, and latency/throughput tradeoffs
• Experience owning a customer- or product-facing API service end to end, including SLAs, incident response, and service reliability
• Track record hiring, mentoring, and retaining senior technical talent, and scaling engineering organizations through rapid growth
• Strong technical judgment across latency, throughput, reliability, cost, and delivery speed
• Demonstrated ability to set technical strategy and execute as priorities change
• Ability to align ML, research, product engineering, and executive stakeholders with competing priorities