Research Lead, Evaluations
Black Forest Labs · Freiburg (Germany)
Frontier labonsitelead$280k–$324k
At a glance
Highlights
- Lead the eval roadmap that guides decisions across frontier visual intelligence.
- Build benchmarks and human plus AI evals to measure what truly matters.
- Monitor critical training runs to catch regressions and new capabilities early.
What they offer
- Equity
Ideal candidate
An eval-obsessed research leader who cares deeply about precise measurement and growing people. You think from first principles, communicate with clarity and low ego, and thrive guiding frontier research decisions.
Requirements
- Proven experience designing, running and maintaining large evaluation suites for frontier AI
- Strong research background in AI evaluations with Python and agentic coding
- At least 1 year experience actively managing and growing a team
- Strong understanding of statistics, variance and significance testing
- Excellent communication skills for sharing results and limitations
- First-principles thinking to craft evals for new capabilities
Lab profile
About Black Forest Labs
Team behind Stable Diffusion and FLUX building frontier image and video generation models.
What they build
- FLUX image generation models
- FLUX video generation models
Known for
- Pioneers of Latent Diffusion and Stable Diffusion
- State-of-the-art image and video generation
- Models used by millions of creators and businesses
Key facts
- Headquartered in Freiburg, Germany
- Presence in San Francisco
Posted · Last seen