Skip to content
← Inworld AI

Senior / Lead Machine Learning Engineer, Inference - Germany

Inworld AI · Germany

Applied AIremoteSenior / Lead
Apply on the lab’s site ↗

At a glance

Highlights

  • Serve LLMs and speech models powering hundreds of millions of daily users.
  • Run realtime inference behind modular APIs at 10 trillion tokens monthly.
  • Build sub-second multimodal inference for companions, health, media and more.

What they offer

  • U.S. visa and relocation support for potential future Bay Area relocation

Ideal candidate

Fast-learning builder who thrives in ambiguity and takes unclear problems to shipped, stable systems. You obsess over latency, reliability and real-world impact over theory.

Requirements

  • Deep understanding of modern serving frameworks and techniques like vLLM or TRT-LLM
  • Hands-on experience with quantization, distillation, caching, continuous batching, paged attention and speculative decoding
  • Proficiency in C++, CUDA, Rust or highly optimized Python with NVIDIA GPU profiling and optimization
  • Experience with Kubernetes, Ray, custom load balancing and multi-GPU/multi-node inference handling thousands of concurrent connections
  • Ability to take a model from research through containerization and optimization to reliable production
  • PhD in CS, Physics, Math or equivalent practical experience building backend or ML systems
  • Professional fluency in English, collaborating daily with US-based teams
visa sponsorship
U.S. visa and relocation support may be available for future Bay Area relocation

Lab profile

About Inworld AI

Research lab and inference provider building realtime speech models and LLM APIs for consumer apps.

What they build

  • First-party speech models
  • LLM serving
  • Modular realtime APIs

Known for

  • Realtime AI for consumer-facing applications
  • High-volume realtime inference
  • Infrastructure for large-scale workloads

Key facts

  • Hundreds of millions of users daily
  • Over 10 trillion LLM tokens served per month
More about Inworld AI →
Apply on the lab’s site ↗

Posted · Last seen