Evaluations Team Lead

Highlights

• Lead how NEXUS, the world's most powerful Large Tabular Model, is measured.
• Build the shared evaluation platform used by engineering, research and Applied AI.
• Turn benchmark findings into research priorities and release recommendations.

What they offer

• Competitive compensation with salary and equity
• Comprehensive health coverage for you and your dependents
• Paid parental leave for all new parents, inclusive of adoptive and surrogate journeys
• Relocation support for employees moving to join the team in one of our office locations

Ideal candidate

A hands-on player-coach who loves rigorous measurement and has owned evaluation for production tabular ML. You bring strong statistical judgment and enjoy challenging claims to set standards others trust.

Requirements

• Experience owning evaluation for tabular ML systems used in production or consequential customer decisions.
• Strong statistical judgment: choosing metrics and validation schemes, estimating uncertainty, comparing models across datasets, and accounting for repeated experimentation.
• Practical experience finding leakage in preprocessing, feature construction, joins, temporal dependencies, and related entities across splits.
• Strong Python and SQL skills, familiarity with scikit-learn and gradient-boosted trees, and experience building reliable ML tooling or platforms used by other teams.
• Experience designing fair model comparisons, including hyperparameter search, resource budgets, and end-to-end latency measurement.
• Prior people management experience, including hiring, technical coaching, and performance feedback, while remaining technically involved.
• Clear written and spoken communication with researchers, engineers, and customer data scientists, including the willingness to challenge claims the evidence does not support.