Member of Technical Staff - Evaluations

Highlights

• Build evaluation frameworks capturing reasoning, alignment and usefulness.
• Create tight feedback loops linking data, evals and model behavior.
• Push measurable limits from synthetic evals to real-world interaction.

What they offer

• Top-tier compensation: salary and equity structured to recognize and retain talent globally
• Stock options for everyone who joins and contributes to Reflection's success
• Comprehensive medical, dental, vision, and life insurance with annual wellness allowance
• Lunch and dinner provided in the office daily
• 22 weeks paid parental leave for all new birthing and non-birthing parents, including adoptive and surrogate journeys
• Unlimited paid time off in the U.S. and 30 days in the U.K.
• Visa sponsorship support with long-term immigration pathways where applicable
• Regular off-sites, happy hours, and team celebrations

Ideal candidate

High-agency, collaborative researcher excited by frontier open models who thrives in fast startups and cares deeply about rigorously measuring capabilities to drive real model improvement.

Requirements

• Strong statistical analysis and experimental design skills to rigorously measure model improvements
• Familiarity with LLM evaluation methodologies: static benchmarks, human preference evals, and/or agentic tasks
• High agency and thrive in a fast-paced startup environment with bias for impact over process
• Excited to work in a new frontier lab defining how to measure and accelerate progress toward more capable models
• Collaborative, detail-oriented, and motivated by building feedback loops that make models truly improve