Researcher, Evals

Highlights

• Design eval frameworks capturing how models reason, remember, and interact.
• Embed evaluation systems directly into model training and development loops.
• Prototype user studies and behavioral experiments to ground evals in real use.

What they offer

• Competitive base salary with attractive equity package
• Fully covered medical, dental and vision insurance for you and family
• 9 weeks paternity and 12 weeks maternity leave
• 401(k)
• Monthly commuter allowance
• Flexible PTO
• Daily lunch, dinner and snacks

Ideal candidate

A rigorous, curious researcher excited by measuring real intelligence beyond static benchmarks, who blends scientific thinking with hands-on building and cares about how people actually use AI.

Requirements

• Experience designing or implementing evaluation frameworks for generative models (audio, text, or multimodal)
• Strong technical and analytical skills, ability to translate open-ended research into production-ready systems
• Creativity in defining novel quantitative metrics for subjective or behavioral qualities
• Excitement for building evaluation systems that bridge research and real-world use
• Curiosity and rigor with motivation to measure meaningful progress in intelligent behavior