Staff Software Engineer, AI Platform

Highlights

• Build the shared AI foundation powering all of Harvey's agentic products.
• Own model routing and integration to deploy the right model per task.
• Create shared eval frameworks that set the quality ceiling for legal AI.

What they offer

• Equity
• Bonus

Ideal candidate

Backend platform builder who loves great abstractions and developer experience. You take full ownership in ambiguity and are driven to make agentic AI reliable for high-stakes legal work.

Requirements

• 8+ years building backend systems with 1+ year in AI/ML engineering and technical leadership
• Experience building and shipping multi-model or multi-provider AI systems in production
• Familiarity with context management, session state, or memory systems
• Track record building internal platforms, SDKs, or shared infrastructure adopted by other teams
• Strong judgment on abstractions with pragmatic, incremental shipping
• Bias toward full ownership and navigating ambiguity