Staff Machine Learning Engineer, LLM Inference Optimization
Nebius · Amsterdam, Netherlands · Berlin, Germany · London, United Kingdom · Poland · Prague, Czech Republic · Zurich, Switzerland · Remote - Europe
Infrastructureremotestaff
At a glance
Highlights
- Own the path from model artifact to fast, reliable, cost-efficient endpoint.
- Drive platform-level optimization for latency, throughput and efficiency.
- Build reusable evaluation and rollout frameworks across model families.
What they offer
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams
Ideal candidate
A performance-obsessed ML engineer who loves turning models into fast, efficient production services and leading cross-functional optimization efforts with clear communication.
Requirements
- Strong Python and PyTorch engineering skills
- Hands-on experience deploying or optimizing LLM, VLM, or high-throughput transformer inference systems
- Practical knowledge of at least one modern inference stack such as vLLM, SGLang, TensorRT-LLM, Triton Inference Server, NVIDIA Dynamo, Ray Serve, KServe, or equivalent
- Strong understanding of transformer inference bottlenecks including KV cache, attention, memory bandwidth, batching, parallelism, and long-context serving
- Ability to reason quantitatively about latency, throughput, quality, utilization, and cost tradeoffs
- Strong communication skills and ability to collaborate with research, kernel, infrastructure, product, and customer teams
Lab profile
About Nebius
Full-stack AI cloud platform for data, model training, and production deployment at scale.
What they build
- Full-stack AI cloud platform
Known for
- Large-scale GPU orchestration
- Inference optimization
- Efficient LLM inference and model optimization
- Physical AI infrastructure
Posted · Last seen