Skip to content
← Inworld AI

Staff / Senior Staff Machine Learning Engineer, Inference - USA

Inworld AI · Mountain View, California, USA

Applied AIremotestaff$270k–$430k
Apply on the lab’s site ↗

At a glance

Highlights

  • Build realtime AI powering hundreds of millions of daily users.
  • Serve over 10 trillion LLM tokens per month at scale.
  • Ship speech models and APIs for companions, health, media.

What they offer

  • Bonus
  • Equity
  • Benefits
  • Relocation assistance

Ideal candidate

A fast-learning builder who thrives in ambiguity, takes unclear problems to stable production, and obsesses over latency, reliability and real impact over theory.

Requirements

  • Deep understanding of modern inference serving frameworks and techniques
  • Hands-on experience with quantization, distillation, caching, continuous batching, paged attention and speculative decoding
  • Proficiency in C++, CUDA, Rust or highly optimized Python with GPU profiling and optimization
  • Experience with Kubernetes, Ray, load balancing and multi-GPU/multi-node inference at scale
  • Track record of systems programming projects, open-source contributions or technical deep-dives
  • Ability to take models from research to reliable production serving
  • PhD in CS, Physics, Math or equivalent practical backend or ML systems experience

Lab profile

About Inworld AI

Research lab and inference provider building realtime speech models and LLM APIs for consumer apps.

What they build

  • First-party speech models
  • LLM serving
  • Modular realtime APIs

Known for

  • Realtime AI for consumer-facing applications
  • High-volume realtime inference
  • Infrastructure for large-scale workloads

Key facts

  • Hundreds of millions of users daily
  • Over 10 trillion LLM tokens served per month
More about Inworld AI →
Apply on the lab’s site ↗

Posted · Last seen