Staff / Principal Software Engineer, Inference Platform - USA
Inworld AI · Mountain View, California, USA
Applied AIremotestaff/principal$280k–$350k
At a glance
Highlights
- Design the core platform serving realtime AI to hundreds of millions daily.
- Own GPU scheduling and serving at tens of trillions of tokens a month.
- Take customer models from weights to healthy production serving.
What they offer
- Equity
- Benefits
Ideal candidate
A senior platform builder who thrives owning large-scale systems end to end, from design to production, and partnering with research and product on technical direction.
Requirements
- 8+ years building backend or distributed systems in Go, Rust, Java or C++
- Designed and shipped a multi-service system end to end
- Deep understanding of distributed systems: consistency, failure modes, queuing, load balancing and capacity modelling
- Experience building a platform or developer product with external customers
- Clear technical writing and ability to turn ambiguous problems into design docs
- remote policy
- Hybrid - on-site in South Bay office a few days a week
Lab profile
About Inworld AI
Research lab and inference provider building realtime speech models and LLM APIs for consumer apps.
What they build
- First-party speech models
- LLM serving
- Modular realtime APIs
Known for
- Realtime AI for consumer-facing applications
- High-volume realtime inference
- Infrastructure for large-scale workloads
Key facts
- Hundreds of millions of users daily
- Over 10 trillion LLM tokens served per month
Posted · Last seen