Member of Technical Staff, Enterprise Evals Platform
Mercor · San Francisco
CHECKED 23H AGO
Applied AIonsite$220k–$425k
At a glance
Highlights
- Build verifiers and grading infrastructure that measures enterprise agents at scale.
- Define golden sets that encode expert quality bars for real-world tasks.
- Own rollout gates deciding whether agent changes ship to customers.
What they offer
- Up to $15k relocation bonus
- $10K housing bonus if within 0.5 miles of office
- $1.5K monthly stipend for meals
- Generous equity grant vested over 4 years
- Free Equinox membership
- $200 monthly laundry reimbursement
- $200 monthly personal wellness reimbursement
- Health, Dental, Vision insurance
Ideal candidate
Independent systems thinker who obsesses over measuring real-world quality and making agents reliably earn enterprise trust. Drawn to ambiguous problems spanning research and platform engineering.
Requirements
- Professional, academic, or research experience in agent engineering and evaluation
- Experience building evaluation suites for LLM or agent systems
- Judgment about task and rubric design turning quality into measurable signals
- Strong software engineering fundamentals and ability to work independently on ambiguous problems
- remote policy
- In-person 5 days a week
Lab profile
About Mercor
AI data company organizing human expertise to train frontier models for the AI economy.
What they build
- APEX benchmark family
- Mercor Enterprise
- Human expertise training data platform
Known for
- Massive domain-expert network
- Frontier model training infrastructure
- Real-world professional work evaluation
Key facts
- Millions of domain experts on platform
- Pays over $4M per day to experts