Junior/Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering
Together AI · India · Remote
CHECKED 2H AGO
InfrastructureremoteJunior, Senior, Staff
At a glance
Highlights
- Build the control plane that provisions and runs the GPU inference fleet.
- Design declarative APIs so inference teams scale clusters without tickets.
- Engineer self-healing and rebalancing to squeeze more capacity from hardware.
Ideal candidate
Platform-minded engineer who treats infrastructure as software and cares deeply about developer experience. You own what you build in production and love abstracting operational complexity for other teams.
Requirements
- Strong software engineering background in Go, Python, Rust or similar
- Experience with durable workflow orchestration such as Temporal or Cadence
- Experience building control planes or reconciliation-based orchestration systems
- Experience with event-driven systems using message queues or pub/sub
- Product mindset building internal platforms or APIs for other engineering teams
- remote policy
- Remote in India
Lab profile
About Together AI
AI-native cloud for training and inference on large-scale GPU infrastructure for AI apps and agents.
What they build
- AI-native cloud platform
- GPU clusters for training and inference
- Platform for AI applications and agents
Known for
- Operating large-scale GPU fleets
- Automated infrastructure at massive scale
- Multi-site data center deployment
Key facts
- Over 1M developers
- Operates one of the world's largest GPU fleets
- Infrastructure managing tens of thousands of GPUs