Skip to content
← Nebius

ML Infrastructure Engineer

Nebius · Amsterdam, Netherlands · Remote - Europe · Remote - United States · Czech Republic · Germany · Netherlands · United Kingdom

Infrastructureremote
Apply on the lab’s site ↗

At a glance

Highlights

  • Lead benchmarking of GPU platforms for large-scale ML and AI workloads.
  • Evaluate GPU performance to guide platform optimization and next-gen hardware.
  • Perform acceptance testing for new GPU clusters and build performance dashboards.

What they offer

  • Competitive compensation
  • Career growth and learning opportunities
  • Flexibility and ownership
  • Collaborative and innovative culture
  • Opportunity to work on impactful AI projects
  • International environment and talented teams

Ideal candidate

Deeply technical ML performance enthusiast who loves profiling and optimizing large-scale training and inference. Works independently, communicates clearly, and thrives owning hard infrastructure problems with real impact.

Requirements

  • A profound understanding of theoretical foundations of machine learning
  • Deep understanding of performance aspects of large neural networks training and inference (data/tensor/context/expert parallelism, offloading, custom kernels, hardware features, attention optimisations, dynamic batching etc.)
  • Deep experience with modern deep learning frameworks (PyTorch, JAX, Megatron-LM, Tensort-LLM)
  • Good understanding of the GPU stack: CUDA, NCCL, drivers, and relevant libraries
  • Familiarity with containerized environments (e.g., Docker, Kubernetes)
  • Strong communication and ability to work independently

Lab profile

About Nebius

Full-stack AI cloud platform for data, model training, and production deployment at scale.

What they build

  • Full-stack AI cloud platform

Known for

  • Large-scale GPU orchestration
  • Inference optimization
  • Efficient LLM inference and model optimization
  • Physical AI infrastructure
More about Nebius →
Apply on the lab’s site ↗

Posted · Last seen