Staff Software Engineer, Model Infrastructure

Highlights

• Lead the platform powering every AI request at Harvey.
• Build intelligent routing that keeps frontier models reliable.
• Drive reliability, latency and efficiency for AI inference.

What they offer

• equity
• bonus

Ideal candidate

A platform-minded builder who thrives owning large-scale distributed systems and cares deeply about reliability, simplicity, and enabling other teams to ship AI products.

Requirements

• 7+ years building large-scale distributed systems
• Experience designing and operating highly available production services
• Strong programming skills in Go, Java, Python, Rust, or C++
• Deep understanding of distributed systems, cloud, networking, and observability
• Experience leading technical projects across multiple teams
• Strong communication and collaboration skills