AI Infrastructure Engineer
Mercor · San Francisco
Applied AIonsitesenior$200k–$400k
At a glance
Highlights
- Build and run the GPU platform powering frontier AI training and inference.
- Stand up a multi-cloud accelerator fleet so researchers never think about placement.
- Build self-healing fleet health checks and cost attribution for capacity planning.
What they offer
- Bi-annual performance bonus structure
- Generous equity grant vested over 4 years
- Up to $15k relocation bonus
- $10K housing bonus (if you live within 0.5 miles of office)
- $1.5K monthly stipend for meals
- Free Equinox membership
- $200 monthly laundry reimbursement
- $200 monthly personal wellness reimbursement
- Health, Dental, Vision insurance
Ideal candidate
Infrastructure owner with 5+ years running production distributed systems who thrives with end-to-end ownership. You care about reliability, utilization, and empowering researchers.
Requirements
- 5+ years building and operating production distributed systems or ML infrastructure
- Write production-quality Python plus Go or C++, and fluent in shell scripting
- Deep hands-on Kubernetes and container experience, plus working knowledge of Slurm or another HPC resource manager
- Run GPU workloads at scale, including scheduling, orchestration and troubleshooting
- Hands-on experience with PyTorch Distributed, Ray, vLLM or Megatron-LM
- Deep experience with at least one major cloud provider
- Know observability tools like DataDog, Prometheus, PromQL and Grafana, and comfortable on-call for critical systems
- Own projects end to end with little direction
- remote policy
- in-person 5 days a week
Lab profile
About Mercor
AI data company organizing human expertise to train frontier models for the AI economy.
What they build
- APEX benchmark family
- Mercor Enterprise
- Human expertise training data platform
Known for
- Massive domain-expert network
- Frontier model training infrastructure
- Real-world professional work evaluation
Key facts
- Millions of domain experts on platform
- Pays over $4M per day to experts
Posted · Last seen