Senior Machine Learning Engineer, LLM Inference Optimization
Nebius · Zurich, Switzerland · Remote - Europe
Infrastructureremotesenior
At a glance
Highlights
- Own LLM endpoint optimization from model artifacts through production deployment.
- Improve latency, throughput and cost per token under real-world workloads.
- Scale dense and mixture-of-experts inference across multi-node GPUs.
What they offer
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams
Ideal candidate
Senior ML engineer who loves squeezing maximum performance from production LLM serving. Pragmatic owner who thrives diagnosing bottlenecks end-to-end and shipping reliable, cost-efficient improvements.
Requirements
- Strong engineering skills in Python and PyTorch
- Experience with distillation, speculative decoding, EAGLE, Medusa, multi-token prediction or related inference acceleration methods
- Experience supporting agentic workloads involving tool calling, structured outputs, streaming APIs and high concurrency
- Familiarity with CUDA or Triton
- Contributions to open-source projects such as vLLM, SGLang, TensorRT-LLM, FlashInfer, LMCache, PyTorch, Triton, Ray or KServe
- Implementation experience with cache-aware request routing, PDD, or WideEP
- Familiarity with GPU communication libraries and interconnects such as NCCL, NVLink, InfiniBand or RoCE
Lab profile
About Nebius
Full-stack AI cloud platform for data, model training, and production deployment at scale.
What they build
- Full-stack AI cloud platform
Known for
- Large-scale GPU orchestration
- Inference optimization
- Efficient LLM inference and model optimization
- Physical AI infrastructure
Posted · Last seen