[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering
Together AI · San Francisco
CHECKED 3H AGO
Infrastructureonsitejunior, senior, staff$160k–$280k
At a glance
Highlights
- Build manifest-driven control plane that provisions and runs GPU inference fleet.
- Design defragmentation logic that consolidates workloads into contiguous capacity.
- Automate self-healing to drain failed nodes and return healthy capacity.
What they offer
- startup equity
- health insurance
- competitive benefits
Ideal candidate
Product-minded platform engineer who loves building self-service APIs for other engineers and owning them in production. You think in systems and efficiency, obsessing over developer experience and squeezing more out of hardware.
Requirements
- Strong software engineering background in Go, Python, Rust, or similar
- Experience with durable workflow orchestration tools such as Temporal, Cadence, or equivalent
- Experience building software control planes or orchestration systems that model and reconcile state over time
- Experience designing event-driven systems around message queues, event streams, or pub/sub
- Product mindset with experience building internal platforms or APIs for other engineering teams
Lab profile
About Together AI
AI-native cloud for training and inference on large-scale GPU infrastructure for AI apps and agents.
What they build
- AI-native cloud platform
- GPU clusters for training and inference
- Platform for AI applications and agents
Known for
- Operating large-scale GPU fleets
- Automated infrastructure at massive scale
- Multi-site data center deployment
Key facts
- Over 1M developers
- Operates one of the world's largest GPU fleets
- Infrastructure managing tens of thousands of GPUs