Staff / Senior Staff Machine Learning Engineer, Inference - USA
Inworld AI · Mountain View, California, USA
Applied AIremotestaff$270k–$430k
At a glance
Highlights
- Build realtime AI powering hundreds of millions of daily users.
- Serve over 10 trillion LLM tokens per month at scale.
- Ship speech models and APIs for companions, health, media.
What they offer
- Bonus
- Equity
- Benefits
- Relocation assistance
Ideal candidate
A fast-learning builder who thrives in ambiguity, takes unclear problems to stable production, and obsesses over latency, reliability and real impact over theory.
Requirements
- Deep understanding of modern inference serving frameworks and techniques
- Hands-on experience with quantization, distillation, caching, continuous batching, paged attention and speculative decoding
- Proficiency in C++, CUDA, Rust or highly optimized Python with GPU profiling and optimization
- Experience with Kubernetes, Ray, load balancing and multi-GPU/multi-node inference at scale
- Track record of systems programming projects, open-source contributions or technical deep-dives
- Ability to take models from research to reliable production serving
- PhD in CS, Physics, Math or equivalent practical backend or ML systems experience
Lab profile
About Inworld AI
Research lab and inference provider building realtime speech models and LLM APIs for consumer apps.
What they build
- First-party speech models
- LLM serving
- Modular realtime APIs
Known for
- Realtime AI for consumer-facing applications
- High-volume realtime inference
- Infrastructure for large-scale workloads
Key facts
- Hundreds of millions of users daily
- Over 10 trillion LLM tokens served per month
Posted · Last seen