Principal Manager, ML Solutions Architecture - Token Factory
Nebius · Remote - United States · United States
Infrastructureremoteprincipal$228k–$285k
At a glance
Highlights
- Lead US Solutions Architects delivering PoCs on Token Factory serverless platform.
- Own delivery from PoC kick-off to optimized dedicated endpoints in production.
- Shape inference stack with speculative decoding, quantization and routing.
What they offer
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams
Ideal candidate
A hands-on engineering leader who thrives owning customer delivery and coaching SAs to strong outcomes. You value rigor, direct feedback, and moving prototypes to reliable production.
Requirements
- Debug inference workloads at the framework level
- Work with multimodal AI models (vision-language, speech)
- Proficiency with DevOps tooling (Docker, Kubernetes) and infrastructure-as-code
- Proficiency in Python
- Familiarity with vLLM, TensorRT-LLM, SGLang, Transformers
- remote policy
- Remote within the United States
Lab profile
About Nebius
Full-stack AI cloud platform for data, model training, and production deployment at scale.
What they build
- Full-stack AI cloud platform
Known for
- Large-scale GPU orchestration
- Inference optimization
- Efficient LLM inference and model optimization
- Physical AI infrastructure
Posted · Last seen