Skip to content
← Nebius

Staff Machine Learning Engineer, LLM Inference Optimization

Nebius · Amsterdam, Netherlands · Berlin, Germany · London, United Kingdom · Poland · Prague, Czech Republic · Zurich, Switzerland · Remote - Europe

Infrastructureremotestaff
Apply on the lab’s site ↗

At a glance

Highlights

  • Own the path from model artifact to fast, reliable, cost-efficient endpoint.
  • Drive platform-level optimization for latency, throughput and efficiency.
  • Build reusable evaluation and rollout frameworks across model families.

What they offer

  • Competitive compensation
  • Career growth and learning opportunities
  • Flexibility and ownership
  • Collaborative and innovative culture
  • Opportunity to work on impactful AI projects
  • International environment and talented teams

Ideal candidate

A performance-obsessed ML engineer who loves turning models into fast, efficient production services and leading cross-functional optimization efforts with clear communication.

Requirements

  • Strong Python and PyTorch engineering skills
  • Hands-on experience deploying or optimizing LLM, VLM, or high-throughput transformer inference systems
  • Practical knowledge of at least one modern inference stack such as vLLM, SGLang, TensorRT-LLM, Triton Inference Server, NVIDIA Dynamo, Ray Serve, KServe, or equivalent
  • Strong understanding of transformer inference bottlenecks including KV cache, attention, memory bandwidth, batching, parallelism, and long-context serving
  • Ability to reason quantitatively about latency, throughput, quality, utilization, and cost tradeoffs
  • Strong communication skills and ability to collaborate with research, kernel, infrastructure, product, and customer teams

Lab profile

About Nebius

Full-stack AI cloud platform for data, model training, and production deployment at scale.

What they build

  • Full-stack AI cloud platform

Known for

  • Large-scale GPU orchestration
  • Inference optimization
  • Efficient LLM inference and model optimization
  • Physical AI infrastructure
More about Nebius →
Apply on the lab’s site ↗

Posted · Last seen