Senior Software Engineer — Infra Agent Systems
Together AI · San Francisco
CHECKED 3H AGO
Infrastructureonsitesenior$250k–$300k
At a glance
Highlights
- Build production AI agents that diagnose failures across a massive GPU fleet.
- Turn fleet telemetry and incident history into smarter fleet intelligence.
- Define the future of autonomous infrastructure operating at massive scale.
What they offer
- startup equity
- health insurance
- other benefits
Ideal candidate
Systems-minded backend builder who owns services end-to-end and wants to make AI agents trustworthy enough to run production infrastructure at massive scale.
Requirements
- 5+ years building production backend systems, distributed systems, or infrastructure platforms
- Strong systems design and owning significant systems from design through production
- Depth in AI agent systems, orchestration, tool use, evaluation, or grounding
- Experience with knowledge graphs or graph data modeling
- Experience with search, retrieval, ranking, RAG, or semantic search systems
- Strong backend engineering including API design, service boundaries, and data modeling
- Experience with Kubernetes, GitOps, infrastructure-as-code, and cloud platforms
- Comfortable working across Go, TypeScript, Python, or Rust
- remote policy
- flexibility in terms of remote work
Lab profile
About Together AI
AI-native cloud for training and inference on large-scale GPU infrastructure for AI apps and agents.
What they build
- AI-native cloud platform
- GPU clusters for training and inference
- Platform for AI applications and agents
Known for
- Operating large-scale GPU fleets
- Automated infrastructure at massive scale
- Multi-site data center deployment
Key facts
- Over 1M developers
- Operates one of the world's largest GPU fleets
- Infrastructure managing tens of thousands of GPUs