Senior Site Reliability Engineer — Token Factory (Inference Platform)
Nebius · Amsterdam, Netherlands · Berlin, Germany · London, United Kingdom · Prague, Czech Republic · Remote - Europe
Infrastructureremotesenior
At a glance
Highlights
- Own reliability of inference platform serving text, vision and audio models at scale.
- Build self-healing systems that keep massive inference workloads running flawlessly.
- Scale platform smoothly while hitting aggressive cost and reliability targets.
What they offer
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams
Ideal candidate
Production-hardened infrastructure engineer who thrives debugging distributed systems end-to-end and cares deeply about self-healing design, turning reliability into an invisible feature for AI users.
Requirements
- Deep fluency with Kubernetes and infrastructure-as-code with Terraform
- Experience with Prometheus and Grafana for observability
- Comfortable scripting in Python or Bash
- Strong understanding of alert design and SLOs for high-throughput APIs
- Production experience operating distributed back-end systems
- Experience with GPU-heavy workloads such as vLLM, Triton, or Ray
- Background in MLOps or model-hosting platforms
Lab profile
About Nebius
Full-stack AI cloud platform for data, model training, and production deployment at scale.
What they build
- Full-stack AI cloud platform
Known for
- Large-scale GPU orchestration
- Inference optimization
- Efficient LLM inference and model optimization
- Physical AI infrastructure
Posted · Last seen