Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering
Together AI · India · Remote
Infrastructureremotesenior
At a glance
Highlights
- Build manifest-driven control plane that provisions and runs GPU inference fleet.
- Design defragmentation and rebalancing logic to squeeze more capacity from hardware.
- Own self-healing fleet health and automated remediation without human in the loop.
Ideal candidate
Product-minded platform engineer who loves abstracting operational complexity behind clean APIs and cares deeply about developer experience. You treat infrastructure as software and own what you build in production.
Requirements
- Strong software engineering background in Go, Python, Rust or similar
- Experience with durable workflow orchestration like Temporal or Cadence for long-lived workflows
- Experience building control planes or orchestration systems with state reconciliation
- Experience with event-driven systems using Kafka, NATS, SQS or similar
- Product mindset building internal platforms or APIs for other engineering teams
- remote policy
- Remote in India
Lab profile
About Together AI
AI-native cloud for training and inference on large-scale GPU infrastructure for AI apps and agents.
What they build
- AI-native cloud platform
- GPU clusters for training and inference
- Platform for AI applications and agents
Known for
- Operating large-scale GPU fleets
- Automated infrastructure at massive scale
- Multi-site data center deployment
Key facts
- Over 1M developers
- Operates one of the world's largest GPU fleets
- Infrastructure managing tens of thousands of GPUs
Posted · Last seen