Skip to content
← Together AI

Senior Software Engineer - Together Cloud Platform

Together AI · San Francisco

CHECKED 3H AGO

InfrastructureonsiteSenior$160k–$230k
Apply on the lab’s site ↗

At a glance

Highlights

  • Build highly available global AI cloud virtualizing cutting-edge ML hardware.
  • Develop distributed GPU scheduling for on-demand Instant Clusters product.
  • Build global management plane spanning dozens of data centers worldwide.

What they offer

  • Startup equity
  • Health insurance
  • Flexibility in terms of remote work

Ideal candidate

A seasoned backend engineer with 5+ years building large-scale distributed systems who thrives on hard infrastructure challenges and cares deeply about scalability, reliability, and clean design.

Requirements

  • 5+ years building large-scale, fault-tolerant distributed systems and API microservices
  • Experience designing and improving efficiency, scalability, and stability of system resources
  • Excellent communication skills and ability to write clear design docs
  • Experience building and operating high-performance, globally distributed microservices on AWS, Azure, or GCP
  • Strong systems knowledge across compute, networking, and storage including concurrency and performant I/O
  • Experience developing against and managing PostgreSQL
  • Expert-level programmer, Golang preferred, with version control and IaC with CI/CD proficiency
  • Experience with Kubernetes and containers preferred
  • Experience with data infrastructure such as Kinesis, Airflow, Kafka a plus
  • Bachelor's or Master's in Computer Science, Computer Engineering or related field or equivalent experience
remote policy
Flexibility in terms of remote work

Lab profile

About Together AI

AI-native cloud for training and inference on large-scale GPU infrastructure for AI apps and agents.

What they build

  • AI-native cloud platform
  • GPU clusters for training and inference
  • Platform for AI applications and agents

Known for

  • Operating large-scale GPU fleets
  • Automated infrastructure at massive scale
  • Multi-site data center deployment

Key facts

  • Over 1M developers
  • Operates one of the world's largest GPU fleets
  • Infrastructure managing tens of thousands of GPUs
More about Together AI →
Apply on the lab’s site ↗