Skip to content
← Nebius

Senior Machine Learning Engineer, LLM Inference Optimization

Nebius · Zurich, Switzerland · Remote - Europe

Infrastructureremotesenior
Apply on the lab’s site ↗

At a glance

Highlights

  • Own LLM endpoint optimization from model artifacts through production deployment.
  • Improve latency, throughput and cost per token under real-world workloads.
  • Scale dense and mixture-of-experts inference across multi-node GPUs.

What they offer

  • Competitive compensation
  • Career growth and learning opportunities
  • Flexibility and ownership
  • Collaborative and innovative culture
  • Opportunity to work on impactful AI projects
  • International environment and talented teams

Ideal candidate

Senior ML engineer who loves squeezing maximum performance from production LLM serving. Pragmatic owner who thrives diagnosing bottlenecks end-to-end and shipping reliable, cost-efficient improvements.

Requirements

  • Strong engineering skills in Python and PyTorch
  • Experience with distillation, speculative decoding, EAGLE, Medusa, multi-token prediction or related inference acceleration methods
  • Experience supporting agentic workloads involving tool calling, structured outputs, streaming APIs and high concurrency
  • Familiarity with CUDA or Triton
  • Contributions to open-source projects such as vLLM, SGLang, TensorRT-LLM, FlashInfer, LMCache, PyTorch, Triton, Ray or KServe
  • Implementation experience with cache-aware request routing, PDD, or WideEP
  • Familiarity with GPU communication libraries and interconnects such as NCCL, NVLink, InfiniBand or RoCE

Lab profile

About Nebius

Full-stack AI cloud platform for data, model training, and production deployment at scale.

What they build

  • Full-stack AI cloud platform

Known for

  • Large-scale GPU orchestration
  • Inference optimization
  • Efficient LLM inference and model optimization
  • Physical AI infrastructure
More about Nebius →
Apply on the lab’s site ↗

Posted · Last seen