Cyber Evaluations Engineer

Highlights

• Build and run evals measuring cyber capabilities and safeguard robustness in models.
• Run per-release robustness testing ahead of major model launches to probe safeguards.
• Design probes that detect cyber abuse in production and shape detection architecture.

What they offer

• Competitive compensation and benefits
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours

Ideal candidate

Hands-on security researcher who loves breaking and measuring systems and translating findings into stronger safeguards. Collaborative communicator excited to shape AI safety through rigorous testing and detection work.

Requirements

• Experience building or running evaluations, benchmarks, or test suites for software or ML systems, including delivering results on short, fixed timelines
• Hands-on cybersecurity experience (e.g., CTF participation, vulnerability research, exploit development, or security research)
• Proficiency in Python
• Strong ability to communicate evaluation results with cross-functional and policy stakeholders
• Bachelor's degree or equivalent combination of education, training and/or experience