Skip to content
← Inworld AI

Staff / Principal Software Engineer, Inference Platform - USA

Inworld AI · Mountain View, California, USA

Applied AIremotestaff/principal$280k–$350k
Apply on the lab’s site ↗

At a glance

Highlights

  • Design the core platform serving realtime AI to hundreds of millions daily.
  • Own GPU scheduling and serving at tens of trillions of tokens a month.
  • Take customer models from weights to healthy production serving.

What they offer

  • Equity
  • Benefits

Ideal candidate

A senior platform builder who thrives owning large-scale systems end to end, from design to production, and partnering with research and product on technical direction.

Requirements

  • 8+ years building backend or distributed systems in Go, Rust, Java or C++
  • Designed and shipped a multi-service system end to end
  • Deep understanding of distributed systems: consistency, failure modes, queuing, load balancing and capacity modelling
  • Experience building a platform or developer product with external customers
  • Clear technical writing and ability to turn ambiguous problems into design docs
remote policy
Hybrid - on-site in South Bay office a few days a week

Lab profile

About Inworld AI

Research lab and inference provider building realtime speech models and LLM APIs for consumer apps.

What they build

  • First-party speech models
  • LLM serving
  • Modular realtime APIs

Known for

  • Realtime AI for consumer-facing applications
  • High-volume realtime inference
  • Infrastructure for large-scale workloads

Key facts

  • Hundreds of millions of users daily
  • Over 10 trillion LLM tokens served per month
More about Inworld AI →
Apply on the lab’s site ↗

Posted · Last seen