Skip to content
← Nebius

Senior Machine Learning Engineer, LLM Inference Optimization

Nebius · Palo Alto, California, United States · San Francisco Bay Area

Infrastructureonsitesenior$195k–$262k
Apply on the lab’s site ↗

At a glance

Highlights

  • Own model and endpoint optimization from artifacts to production deployment.
  • Improve latency, throughput and cost per token under real workloads.
  • Scale dense and mixture-of-experts inference across multi-GPU nodes.

What they offer

  • 100% company-paid medical, dental, and vision coverage for employees and families
  • 401(k) plan with up to 4% company match with immediate vesting
  • 20 weeks paid parental leave for primary caregivers, 12 weeks for secondary
  • Up to $85/month remote work reimbursement for mobile and internet
  • Company-paid short-term, long-term disability and life insurance

Ideal candidate

A hands-on performance-obsessed ML engineer who thrives owning optimization end-to-end and cares deeply about latency, efficiency, and reliable production AI at scale.

Requirements

  • Strong engineering skills in Python and PyTorch
  • Hands-on experience deploying or optimizing LLM, VLM, or high-throughput transformer inference

Lab profile

About Nebius

Full-stack AI cloud platform for data, model training, and production deployment at scale.

What they build

  • Full-stack AI cloud platform

Known for

  • Large-scale GPU orchestration
  • Inference optimization
  • Efficient LLM inference and model optimization
  • Physical AI infrastructure
More about Nebius →
Apply on the lab’s site ↗

Posted · Last seen