Member of Technical Staff, Model Efficiency

Highlights

• Push boundaries of LLM inference efficiency across production workloads.
• Improve latency and throughput for frontier enterprise AI models.
• Ship optimizations that accelerate large-scale model execution.

What they offer

• Equity
• Full health and dental benefits including mental health budget
• 6 weeks paid vacation
• 100% parental leave top-up up to 6 months
• $500 home office stipend plus co-working benefit

Ideal candidate

A performance-obsessed engineer with 5+ years building production systems who ships fast, measures impact, and loves digging into bottlenecks to make frontier models faster and more reliable.

Requirements

• 5+ years of experience writing high-performance, production-quality code
• Strong programming skills in C++ or Python (Rust/Go also welcome)
• Experience with large language models and LLM inference ecosystem (e.g., vLLM, SGLang)
• Ability to diagnose and resolve performance bottlenecks across model execution stack
• Strong bias for action — ship fast, measure impact, and iterate