Senior Software Engineer, Observability
Together AI · San Francisco
CHECKED 2H AGO
Infrastructureonsitesenior$200k–$280k
At a glance
Highlights
- Build the AI Acceleration Cloud powering full generative AI lifecycle.
- Scale foundational systems serving 400+ trillion tokens a month.
- Drive insights into system performance and GPU utilization at scale.
What they offer
- startup equity
- health insurance
- remote work flexibility
Ideal candidate
Seasoned reliability-focused engineer who loves scaling large platforms and turning complex signals into clarity. You thrive on proactive problem-solving, deep system ownership, and empowering teams with actionable insight.
Requirements
- Expertise in observability platforms (Prometheus, Grafana, ClickStack, OpenTelemetry) and cloud-native monitoring services (AWS, GCP, Azure)
- Strong programming skills in Go, Python, or similar languages, with proficiency in infrastructure-as-code tools (Terraform, Ansible, Helm)
- Experience designing, operating, and scaling large-scale distributed systems and pipelines for high-volume data ingestion and real-time querying
- Deep understanding of containerization (Docker) and orchestration (Kubernetes)
- Knowledge of microservices architecture, service mesh technologies, CI/CD pipelines, and GitOps workflows
- Expertise in managing databases (PostgreSQL, MongoDB, Redis) and time-series databases with high-cardinality data
- remote policy
- flexibility in terms of remote work
Lab profile
About Together AI
AI-native cloud for training and inference on large-scale GPU infrastructure for AI apps and agents.
What they build
- AI-native cloud platform
- GPU clusters for training and inference
- Platform for AI applications and agents
Known for
- Operating large-scale GPU fleets
- Automated infrastructure at massive scale
- Multi-site data center deployment
Key facts
- Over 1M developers
- Operates one of the world's largest GPU fleets
- Infrastructure managing tens of thousands of GPUs