Staff Software Engineer - AI Compute, Together Cloud
Together AI · San Francisco
CHECKED 2H AGO
Infrastructureonsitestaff$260k–$300k
At a glance
Highlights
- Build next-gen AI cloud powering inference, RL and fine-tuning products.
- Architect global control plane spanning dozens of data centers.
- Lead build-out of new Vera Rubin data center with thousands of GPUs.
What they offer
- startup equity
- health insurance
- flexibility in terms of remote work
Ideal candidate
Deeply technical systems builder and clear communicator who thrives in ambiguity and loves architecting large-scale infrastructure. You lead through influence, set high engineering standards, and mentor others to ship reliable platforms fast.
Requirements
- Deep experience with VMs/hypervisors such as QEMU/KVM, VFIO, virtio and SR-IOV
- Deep experience with DC networking such as VLAN, VXLAN, VPC and OVS/OVN
- Experience virtualizing GPUs and/or InfiniBand
- Experience building IaaS or PaaS systems at scale
- Experience with DPUs/SmartNICs
- Experience with Cluster API or similar
- GPU programming, NCCL, CUDA knowledge
Lab profile
About Together AI
AI-native cloud for training and inference on large-scale GPU infrastructure for AI apps and agents.
What they build
- AI-native cloud platform
- GPU clusters for training and inference
- Platform for AI applications and agents
Known for
- Operating large-scale GPU fleets
- Automated infrastructure at massive scale
- Multi-site data center deployment
Key facts
- Over 1M developers
- Operates one of the world's largest GPU fleets
- Infrastructure managing tens of thousands of GPUs