Senior Backend Engineer, Inference Platform
Together AI · San Francisco
CHECKED 2H AGO
Infrastructureonsitesenior$200k–$290k
At a glance
Highlights
- Build the inference backbone for multi-tenant serverless and dedicated endpoints.
- Optimize global routing and auto-scaling across dozens of data centers.
- Bring frontier generative AI models from research into real-world production.
What they offer
- startup equity
- health insurance
- competitive benefits
Ideal candidate
A performance-obsessed distributed systems builder who thrives on deep ownership and shaving milliseconds at massive scale. You love turning cutting-edge research into reliable, real-world systems.
Requirements
- 5+ years building large-scale, fault-tolerant distributed systems and API microservices
- Strong background improving efficiency, scalability, and stability of complex systems
- Excellent understanding of low-level OS concepts including threading, memory, networking, and storage
- Expert-level programming in one or more of: Rust, Go, Python, or TypeScript
- Bachelor's or Master's in Computer Science, Computer Engineering, or related field or equivalent experience
Lab profile
About Together AI
AI-native cloud for training and inference on large-scale GPU infrastructure for AI apps and agents.
What they build
- AI-native cloud platform
- GPU clusters for training and inference
- Platform for AI applications and agents
Known for
- Operating large-scale GPU fleets
- Automated infrastructure at massive scale
- Multi-site data center deployment
Key facts
- Over 1M developers
- Operates one of the world's largest GPU fleets
- Infrastructure managing tens of thousands of GPUs