Staff / Senior Staff Machine Learning Engineer, Inference - Switzerland
Inworld AI · Switzerland
Applied AIremotestaff / senior staff
At a glance
Highlights
- Serve LLMs and speech models powering hundreds of millions of daily users.
- Build realtime inference serving over 10 trillion LLM tokens per month.
- Power consumer apps across companions, healthcare, fitness and education.
Ideal candidate
A fast-learning builder who thrives in ambiguity and owns unclear problems end-to-end. You obsess over why systems behave as they do and care about shipped, stable, high-impact realtime performance over theory.
Requirements
- Deep understanding of modern serving frameworks like vLLM or TRT-LLM
- Hands-on experience with quantization, distillation, caching, continuous batching, paged attention and speculative decoding
- Proficiency in C++, CUDA, Rust or highly optimized Python with GPU profiling and optimization
- Experience with Kubernetes, Ray, custom load balancing, multi-GPU/multi-node inference at scale
- Ability to take models from research to containerized, optimized production serving
- PhD in CS, Physics, Math or equivalent practical backend or ML systems experience
- Professional fluency in English (written and spoken)
- Legal right to work in Switzerland
- remote policy
- Remote within Switzerland via Employer of Record (EOR)
- visa sponsorship
- No sponsorship for Switzerland; future U.S. visa and relocation support may be available
Lab profile
About Inworld AI
Research lab and inference provider building realtime speech models and LLM APIs for consumer apps.
What they build
- First-party speech models
- LLM serving
- Modular realtime APIs
Known for
- Realtime AI for consumer-facing applications
- High-volume realtime inference
- Infrastructure for large-scale workloads
Key facts
- Hundreds of millions of users daily
- Over 10 trillion LLM tokens served per month
Posted · Last seen