Senior Machine Learning Engineer, LLM Inference Optimization
Nebius · Palo Alto, California, United States · San Francisco Bay Area
Infrastructureonsitesenior$195k–$262k
At a glance
Highlights
- Own model and endpoint optimization from artifacts to production deployment.
- Improve latency, throughput and cost per token under real workloads.
- Scale dense and mixture-of-experts inference across multi-GPU nodes.
What they offer
- 100% company-paid medical, dental, and vision coverage for employees and families
- 401(k) plan with up to 4% company match with immediate vesting
- 20 weeks paid parental leave for primary caregivers, 12 weeks for secondary
- Up to $85/month remote work reimbursement for mobile and internet
- Company-paid short-term, long-term disability and life insurance
Ideal candidate
A hands-on performance-obsessed ML engineer who thrives owning optimization end-to-end and cares deeply about latency, efficiency, and reliable production AI at scale.
Requirements
- Strong engineering skills in Python and PyTorch
- Hands-on experience deploying or optimizing LLM, VLM, or high-throughput transformer inference
Lab profile
About Nebius
Full-stack AI cloud platform for data, model training, and production deployment at scale.
What they build
- Full-stack AI cloud platform
Known for
- Large-scale GPU orchestration
- Inference optimization
- Efficient LLM inference and model optimization
- Physical AI infrastructure
Posted · Last seen