Inference Engineer

Highlights

• Build low-latency, scalable inference stack for cutting-edge foundation models.
• Advance real-time multimodal intelligence used across devices and applications.
• Own robust inference infrastructure and monitoring for fast, reliable products.

What they offer

• Competitive base salary and equity package
• Fully covered medical, dental and vision for you and family
• 9 weeks paternity and 12 weeks maternity leave
• 401(k) plan
• Monthly commuter allowance
• Flexible PTO
• Daily lunch, dinner and snacks

Ideal candidate

A strong systems-minded engineer who thrives in ambiguity and loves shipping fast, reliable zero-to-one infrastructure that brings cutting-edge AI to real products.

Requirements

• Strong engineering skills, comfortable navigating complex codebases and writing clean, maintainable code
• Experience building large-scale distributed systems with high demands on performance, reliability and observability
• Technical leadership with ability to execute and deliver zero-to-one results amidst ambiguity
• Background in or experience working on inference pipelines with machine learning and generative models
• Experience implementing state of the art machine learning models and research to applied problems
• Preferable: experience with vLLM, SGLang, Continuous Batching or other inference frameworks
• Preferable: experience working in CUDA, Triton or similar