Staff Software Engineer, AI Platform

Highlights

• Build the shared AI foundation powering all of Harvey's agentic products.
• Own model routing and integration across foundation models.
• Create eval tooling that sets quality bar for legal AI.

Ideal candidate

Platform-minded builder who loves owning ambiguous infrastructure and enabling other teams to ship. Excited by high-stakes agentic AI and making autonomous systems reliable for legal work.

Requirements

• 8+ years building backend systems with 1+ year in AI/ML engineering and technical leadership across teams
• Experience building and shipping multi-model or multi-provider AI systems in production
• Familiarity with context management, session state, or memory systems
• Track record building internal platforms, SDKs, or shared infrastructure adopted by other teams
• Strong judgment on abstractions with pragmatic, incremental shipping approach
• Bias toward full ownership and navigating ambiguity