Research Engineer / Scientist, Data & Evals

Highlights

• Build synthetic data pipelines for complex legal reasoning and agentic workflows.
• Design evals and benchmarks like Legal Agent Benchmark tracking real workflows.
• Turn expert feedback and product usage into training signals and rewards.

What they offer

• Equity
• Bonus

Ideal candidate

A rigorous research engineer who obsesses over measurement and thrives on ambiguous quality problems. You love partnering with experts to turn real-world failures into measurable model improvements.

Requirements

• Experience building data pipelines, ML evaluation systems, or experimentation tooling with ownership of production-quality code
• Rigorous approach to measurement including statistical reasoning and experimental design
• Ability to translate ambiguous goals or expert judgment into structured datasets, rubrics, and measurable criteria
• Experience with synthetic data, LLM evaluations, automated raters, or preference data is a plus