Member of Technical Staff - Evaluation Infrastructure

Highlights

• Build reliable infrastructure that runs all evaluations at scale.
• Partner with modeling teams to develop new evals and tooling.
• Tackle performance bottlenecks across the full eval stack.

What they offer

• equity
• comprehensive medical, vision, and dental coverage
• 401(k) retirement plan
• short & long-term disability insurance
• life insurance

Ideal candidate

Hands-on engineer who thrives on hard, ambiguous problems and engineering excellence. You love diving deep across the stack, collaborating closely, and communicating clearly to advance AI understanding.

Requirements

• Experience in building, debugging, and optimizing efficiency of large-scale distributed systems
• Willingness to dive deep and solve hard problems at all levels of the stack
• Experience in LLM inference
• Experience in GPU compute management, workload scheduling, and dynamic resource optimization
• Experience in developing interfaces for comparing models and evals