Staff Software Engineer, Core Infrastructure
Harvey AI · San Francisco
CHECKED 8H AGO
Applied AIonsitestaff$236k–$290k
At a glance
Highlights
- Power global legal AI platform processing billions of prompt tokens daily.
- Design next-gen model proxy routing millions of daily inference requests.
- Build multi-region systems meeting strict data residency requirements.
What they offer
- Equity
- Bonus
- Relocation assistance
Ideal candidate
Seasoned infrastructure leader with 10+ years scaling distributed systems who thrives on ownership and operational excellence. You care about reliability at global scale and mentoring others while building resilient foundations for AI products.
Requirements
- 10+ years of experience in Infrastructure Engineering or Platform Engineering in a production environment
- Long track record building and scaling complex, large-scale distributed systems
- Deep proficiency with cloud infrastructure platforms (Azure preferred; GCP or AWS experience transfers well)
- Strong fluency in Infrastructure as Code (IaC) tools — Terraform, Pulumi, or CloudFormation
- Solid understanding of Kubernetes, container orchestration, networking, and cloud security at scale
- Experience with observability tools (Datadog, Sentry) and incident response practices (PagerDuty, Incident.io)
- Strong programming skills in Python, Go, or similar languages
- Excellent problem-solving skills, a "spidey sense" of where things could go wrong, and a commitment to operational excellence
- remote policy
- In-person with relocation assistance
Lab profile
About Harvey AI
Builds frontier agentic AI platform transforming legal and professional services knowledge work.
What they build
- Enterprise AI platform for legal services
- Agentic workflows for professional knowledge work
Known for
- Frontier agentic AI
- Enterprise-grade platform
- Deep legal domain expertise