Research Lead, Open Benchmarks Grants
Snorkel AI · New York City, NY (Hybrid) · San Francisco, CA (Hybrid) · United States (Remote) · Remote
Infrastructurehybridlead$231k–$390k
At a glance
Highlights
- Shape research bets identifying gaps in frontier AI evaluation.
- Advance evaluation research alongside grantees and Research Fellows.
- Drive benchmark adoption directly with leading frontier AI labs.
Ideal candidate
A rigorous evaluation researcher who has built benchmarks or evals used by others and cares about measurement quality. You blend hands-on experimentation with collaborative leadership and clear communication.
Requirements
- Led or made substantial contributions to benchmarks, evaluation methods, or environments used by researchers
- Technical judgment to assess whether an evaluation measures what it claims and design rigorous experiments
- Hands-on depth building experiments, inspecting tasks and harnesses, debugging verifiers, and analyzing model behavior
- Experience helping other researchers make difficult technical decisions and bring work to completion
- Clear technical communication across papers, artifacts, specifications, or reviews
Lab profile
About Snorkel AI
Frontier AI data lab building datasets, benchmarks, and evals for frontier and agentic AI.
What they build
- Datasets for frontier AI
- Benchmarks and evals
- Custom AI data solutions
Known for
- Research-driven AI data development
- Combines technology with expert data development
- Works with leading AI labs and enterprises
Key facts
- Founded in 2019
- Spun out of Stanford AI Lab
Posted · Last seen