Skip to content
← Inworld AI

Senior / Lead Machine Learning Engineer, Inference - Serbia

Inworld AI · Serbia

Applied AIremotesenior
Apply on the lab’s site ↗

At a glance

Highlights

  • Serve realtime AI powering hundreds of millions of users daily.
  • Scale infrastructure serving over 10 trillion LLM tokens monthly.
  • Build speech models and modular APIs for consumer applications.

Ideal candidate

A fast-learning builder who thrives in ambiguity and owns work end-to-end. You obsess over latency, reliability, and real-world impact, question assumptions, and ship stable systems without waiting for a roadmap.

Requirements

  • Deep understanding of modern serving frameworks and techniques like vLLM or TRT-LLM
  • Hands-on experience with quantization, distillation, caching strategies, continuous batching, paged attention, and speculative decoding
  • Proficiency in C++, CUDA, Rust, or highly optimized Python with NVIDIA GPU profiling and optimization
  • Experience with Kubernetes, Ray, custom load balancing, and multi-GPU/multi-node inference handling thousands of concurrent connections
  • Ability to take a model from research through containerization and optimized serving to reliable production
  • PhD in CS, Physics, Math, or equivalent practical experience building backend or ML systems
  • Professional fluency in English (written and spoken) for daily collaboration with US-based teams
visa sponsorship
Full U.S. visa and relocation support may be available for future Bay Area relocation

Lab profile

About Inworld AI

Research lab and inference provider building realtime speech models and LLM APIs for consumer apps.

What they build

  • First-party speech models
  • LLM serving
  • Modular realtime APIs

Known for

  • Realtime AI for consumer-facing applications
  • High-volume realtime inference
  • Infrastructure for large-scale workloads

Key facts

  • Hundreds of millions of users daily
  • Over 10 trillion LLM tokens served per month
More about Inworld AI →
Apply on the lab’s site ↗

Posted · Last seen