Senior Software Engineer, Backend Core Infra
Harvey AI · Bengaluru
Applied AIremotesenior
At a glance
Highlights
- Power infra handling billions of prompt tokens and millions of daily requests.
- Design next-gen model proxy routing millions of daily inference requests.
- Architect multi-region deployments meeting strict enterprise data residency needs.
Ideal candidate
Seasoned infrastructure builder with 8+ years scaling distributed systems who thrives on ownership, operational excellence, and mentoring others to power resilient global AI platforms.
Requirements
- 8+ years in core backend infrastructure or backend platform engineering in production
- Track record building and scaling complex large-scale distributed systems
- Deep proficiency with cloud platforms, Azure preferred with GCP or AWS transferable
- Strong fluency in Infrastructure as Code tools like Terraform, Pulumi or CloudFormation
- Solid understanding of Kubernetes, container orchestration, networking and cloud security
- Experience with observability and incident response practices
- Strong programming skills in Python, Go or similar languages
- visa sponsorship
- No visa sponsorship available
Lab profile
About Harvey AI
Builds frontier agentic AI platform transforming legal and professional services knowledge work.
What they build
- Enterprise AI platform for legal services
- Agentic workflows for professional knowledge work
Known for
- Frontier agentic AI
- Enterprise-grade platform
- Deep legal domain expertise
Posted · Last seen