Staff / Senior Staff Machine Learning Engineer, Inference - UK
Inworld AI · UK
Applied AIremotestaff$184k–$262k
At a glance
Highlights
- Build realtime AI powering hundreds of millions of daily users.
- Serve over 10 trillion LLM tokens per month at scale.
- Build first-party speech models and modular realtime APIs.
What they offer
- Equity
- Benefits
- Potential future U.S. visa and relocation support to Bay Area
Ideal candidate
Fast-learning builder who thrives in ambiguity and owns unclear problems end-to-end. Obsessed with real-world latency, reliability and shipped impact over theory.
Requirements
- Experience with inference optimization and serving frameworks like vLLM or TRT-LLM
- Hands-on experience with quantization, distillation, caching, continuous batching and speculative decoding
- Proficiency in C++, CUDA, Rust or optimized Python with GPU profiling
- Experience with Kubernetes, Ray, load balancing and multi-GPU multi-node inference at scale
- Ability to take models from research to reliable production serving with full ownership
- visa sponsorship
- No visa sponsorship available
Lab profile
About Inworld AI
Research lab and inference provider building realtime speech models and LLM APIs for consumer apps.
What they build
- First-party speech models
- LLM serving
- Modular realtime APIs
Known for
- Realtime AI for consumer-facing applications
- High-volume realtime inference
- Infrastructure for large-scale workloads
Key facts
- Hundreds of millions of users daily
- Over 10 trillion LLM tokens served per month
Posted · Last seen