Software Engineer, Evaluation Platform / Infra

Highlights

• Design and build end-to-end platform for authoring and running model evaluations.
• Make evaluation results reproducible and trustworthy from metrics to trajectories.
• Guide frontier AI research by turning eval insights into model improvements.

What they offer

• Generous health, dental, and vision benefits
• Unlimited PTO
• Paid parental leave
• Relocation support as needed

Ideal candidate

A product-minded platform builder who thrives partnering with researchers and turning messy workflows into reliable, self-serve systems that guide frontier model development.

Requirements

• Bachelor's degree or equivalent practical experience in computer science, engineering, machine learning, or related field
• 2+ years post-grad experience as a software engineer or ML engineer, excluding internships
• Hands-on experience building or maintaining evaluations, benchmarks, graders, or model-quality systems for LLMs or multimodal models
• Strong software engineering fundamentals with experience building reliable, maintainable systems
• Proficiency in at least one backend language (primarily Python and Rust)
• Experience with databases, data pipelines, distributed systems, or other data-intensive infrastructure
• Comfort working across the stack and owning projects from discovery through deployment and operation
• Experience collaborating with cross-functional partners and subject-matter experts