Research Engineer – Benchmarking
Mercor · San Francisco
CHECKED 22H AGO
Applied AIonsite$180k–$500k
At a glance
Highlights
- Own benchmarking pipelines measuring tool use and agentic reasoning at scale.
- Turn failure analysis into improvements for post-training and RLVR.
- Build eval systems and dashboards that guide frontier model training.
What they offer
- Bi-annual performance bonus structure
- Generous equity grant vested over 4 years
- Up to $15k relocation bonus
- $10K housing bonus if you live within 0.5 miles of office
- $1.5K monthly stipend for meals
- Free Equinox membership
- $200 monthly laundry reimbursement
- $200 monthly personal wellness reimbursement
- Health, Dental, Vision insurance
Ideal candidate
Applied researcher who loves dissecting model failures and building rigorous evals. You thrive with high ownership in fast-paced, in-person research teams shaping frontier models.
Requirements
- Strong applied research background with focus on model evaluation, benchmarking, and/or failure analysis
- Strong coding skills and hands-on experience with ML models and evaluation code
- Solid grasp of data structures, algorithms, and backend systems
- Comfort with APIs, SQL/NoSQL, and cloud platforms for running and storing eval results
- Ability to reason about model behavior, experimental results, and data quality from evals and failure analyses
- remote policy
- In-person five days a week
Lab profile
About Mercor
AI data company organizing human expertise to train frontier models for the AI economy.
What they build
- APEX benchmark family
- Mercor Enterprise
- Human expertise training data platform
Known for
- Massive domain-expert network
- Frontier model training infrastructure
- Real-world professional work evaluation
Key facts
- Millions of domain experts on platform
- Pays over $4M per day to experts