Member of Technical Staff, Evals
Handshake AI · San Francisco, CA · Remote (USA) · New York, NY · Mountain View, CA
Infrastructureremote$200k–$350k
At a glance
Highlights
- Design evaluation frameworks and benchmarks for frontier LLMs and AI agents.
- Build reward models, verifiers, and feedback systems that make models improvable.
- Publish open-source benchmarks and research shaping frontier AI progress.
What they offer
- Equity in a fast-growing company
- 401(k) match and financial coaching
- Medical, dental, and vision coverage
- Paid parental leave and fertility benefits
- $500 wellness stipend and $2,000 learning stipend
- Flexible PTO with 15 holidays + 2 flex days
- Free lunch, commuting support and gym in SF office
Ideal candidate
A builder-researcher with demonstrated research chops who loves tinkering with agents, designing rigorous evals, and shipping open benchmarks. Thrives with high ownership in ambiguous, fast-moving frontier AI work.
Requirements
- PhD in ML/AI, computer science, data science, or related fields or equivalent research experience
- Publications at top AI/ML venues like NeurIPS, ICML, ICLR, COLM
- Builders who enjoy tinkering with agents and shipping software, benchmarks, or datasets
- Strong Python skills, experience building scalable software, working with agents
- Strong knowledge of frontier AI: benchmarks, eval techniques, agent harnesses, post-training recipes
- Comfort operating in an ambiguous, fast-moving environment with substantial ownership
Lab profile
About Handshake AI
AI data business creating expert evaluations and benchmarks for frontier AI labs.
What they build
- AI evaluations
- AI benchmarks
- Expert AI training data
Known for
- Fastest-growing AI data business
- Direct work with frontier lab researchers
- 30,000+ expert contributor network
Key facts
- Handshake AI launched in 2025
- 25M job seekers
- 1M+ employers
Posted · Last seen