Member of Technical Staff, Evals Platform

Highlights

• Build eval and post-training infrastructure connecting evaluation to fine-tuning.
• Design new benchmarks for complex, emerging domain-specific use cases.
• Scale eval systems with programmatic access to author evals and iterate quickly.

What they offer

• Equity

Ideal candidate

Metrics-obsessed engineer with 1-7 years building scalable systems who loves digging into LLM evals, reproducing benchmarks, and turning messy customer workflows into polished post-training products.

Requirements

• 1-7 years of software engineering or data science experience
• Strong system design skills for scalable, programmatic systems
• Hands-on experience with sandbox environments for secure code execution
• Deep understanding of LLM evaluations and using results to guide improvement
• Understanding of end-to-end GenAI lifecycle from prompting to production