(Senior/Junior AI Inference Reliability Engineer, Compute Infra
Together AI · San Francisco
Infrastructureonsitesenior$160k–$280k
At a glance
Highlights
- Own production reliability for the inference fleet at massive scale.
- Turn postmortems into permanent automated fixes instead of recurring pages.
- Keep capacity efficiency from becoming a new source of instability.
What they offer
- startup equity
- health insurance
- competitive benefits
Ideal candidate
A builder at heart with a reliability mindset who owns production outcomes and treats on-call experience and automation as products to ship and improve.
Requirements
- Experience operating a provisioning or host-lifecycle pipeline in production
- Hands-on production-reliability experience on large-scale distributed or GPU-serving systems
- Comfort troubleshooting InfiniBand/RDMA and Kubernetes controller/CRD-based platforms
- Experience with adapter-based serving and running differentiated SLOs across model pools of different priority
- Demonstrated track record of eliminating operational toil through automation and tooling you built yourself
- Hands-on experience with Kubernetes controller/CRD patterns, reconciliation loops, and node-level health/remediation systems
- Comfort with event-driven architectures, backpressure/circuit-breaking design, and built-in observability
- Software-engineering mindset: write and ship production code and treat GPU infrastructure as software to be engineered
Lab profile
About Together AI
AI-native cloud for training and inference on large-scale GPU infrastructure for AI apps and agents.
What they build
- AI-native cloud platform
- GPU clusters for training and inference
- Platform for AI applications and agents
Known for
- Operating large-scale GPU fleets
- Automated infrastructure at massive scale
- Multi-site data center deployment
Key facts
- Over 1M developers
- Operates one of the world's largest GPU fleets
- Infrastructure managing tens of thousands of GPUs
Posted · Last seen