ML Infrastructure Engineer
Nebius · Amsterdam, Netherlands · Remote - Europe · Remote - United States · Czech Republic · Germany · Netherlands · United Kingdom
Infrastructureremote
At a glance
Highlights
- Lead benchmarking of GPU platforms for large-scale ML and AI workloads.
- Evaluate GPU performance to guide platform optimization and next-gen hardware.
- Perform acceptance testing for new GPU clusters and build performance dashboards.
What they offer
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams
Ideal candidate
Deeply technical ML performance enthusiast who loves profiling and optimizing large-scale training and inference. Works independently, communicates clearly, and thrives owning hard infrastructure problems with real impact.
Requirements
- A profound understanding of theoretical foundations of machine learning
- Deep understanding of performance aspects of large neural networks training and inference (data/tensor/context/expert parallelism, offloading, custom kernels, hardware features, attention optimisations, dynamic batching etc.)
- Deep experience with modern deep learning frameworks (PyTorch, JAX, Megatron-LM, Tensort-LLM)
- Good understanding of the GPU stack: CUDA, NCCL, drivers, and relevant libraries
- Familiarity with containerized environments (e.g., Docker, Kubernetes)
- Strong communication and ability to work independently
Lab profile
About Nebius
Full-stack AI cloud platform for data, model training, and production deployment at scale.
What they build
- Full-stack AI cloud platform
Known for
- Large-scale GPU orchestration
- Inference optimization
- Efficient LLM inference and model optimization
- Physical AI infrastructure
Posted · Last seen