Software Engineer, Applied AI- Evals

Highlights

• Build scorecards and failure reports that turn eval runs into decisions.
• Run frontier models on APEX benchmarks and publish leaderboard results.
• Help labs and enterprises decide which models and agents to trust.

What they offer

• Bi-annual performance bonus structure
• Generous equity grant vested over 4 years
• Up to $15k relocation bonus
• $10K housing bonus if within 0.5 miles of office
• $1.5K monthly stipend for meals
• Free Equinox membership
• $200 monthly laundry reimbursement
• $200 monthly personal wellness reimbursement
• Health, dental, vision insurance

Ideal candidate

Product-minded builder who owns features end to end and thrives in ambiguity. You care about turning complex eval data into simple, trusted decisions for AI labs and enterprises.

Requirements

• Bachelor's Degree in Computer Science or a related field
• Strong full-stack skills in a modern backend language (Python, Go or TypeScript) and a frontend framework such as React
• Track record of owning product features end to end, from idea to production
• Strong product sense that starts from what the user needs
• Experience building data-heavy products: data models, APIs and views over large volumes of results
• Excellent written and verbal communication with engineers, researchers and customers
• Comfort with ambiguity and a habit of shipping iteratively
• Experience with LLM evals, benchmarks or AI developer tools is a plus
• Startup experience or experience building B2B developer products is a plus