Skip to content
← Handshake AI

Member of Technical Staff, Evals

Handshake AI · San Francisco, CA · Remote (USA) · New York, NY · Mountain View, CA

Infrastructureremote$200k–$350k
Apply on the lab’s site ↗

At a glance

Highlights

  • Design evaluation frameworks and benchmarks for frontier LLMs and AI agents.
  • Build reward models, verifiers, and feedback systems that make models improvable.
  • Publish open-source benchmarks and research shaping frontier AI progress.

What they offer

  • Equity in a fast-growing company
  • 401(k) match and financial coaching
  • Medical, dental, and vision coverage
  • Paid parental leave and fertility benefits
  • $500 wellness stipend and $2,000 learning stipend
  • Flexible PTO with 15 holidays + 2 flex days
  • Free lunch, commuting support and gym in SF office

Ideal candidate

A builder-researcher with demonstrated research chops who loves tinkering with agents, designing rigorous evals, and shipping open benchmarks. Thrives with high ownership in ambiguous, fast-moving frontier AI work.

Requirements

  • PhD in ML/AI, computer science, data science, or related fields or equivalent research experience
  • Publications at top AI/ML venues like NeurIPS, ICML, ICLR, COLM
  • Builders who enjoy tinkering with agents and shipping software, benchmarks, or datasets
  • Strong Python skills, experience building scalable software, working with agents
  • Strong knowledge of frontier AI: benchmarks, eval techniques, agent harnesses, post-training recipes
  • Comfort operating in an ambiguous, fast-moving environment with substantial ownership

Lab profile

About Handshake AI

AI data business creating expert evaluations and benchmarks for frontier AI labs.

What they build

  • AI evaluations
  • AI benchmarks
  • Expert AI training data

Known for

  • Fastest-growing AI data business
  • Direct work with frontier lab researchers
  • 30,000+ expert contributor network

Key facts

  • Handshake AI launched in 2025
  • 25M job seekers
  • 1M+ employers
More about Handshake AI →
Apply on the lab’s site ↗

Posted · Last seen