Sr. Research Scientist - Agent Flywheel

Highlights

• Turn production traces from data agents into signals for self-improvement loops.
• Design benchmarks and RL environments from real workloads for tool-using agents.
• Close the loop between production signals, evaluation, and agent improvement.

What they offer

• annual performance bonus
• equity
• comprehensive benefits and perks

Ideal candidate

A rigorous experimentalist who loves debugging complex stochastic systems and turning noisy signals into metrics that drive real improvement, eager to ship research into products on a small fast-paced team.

Requirements

• Expertise in debugging and diagnosing failures in complex, stochastic, multi-component systems
• Deep instinct for designing metrics and evals that track what actually matters, and questioning noisy, sparse, or biased signals
• Experimental rigor and causal thinking, from offline ablations to online experiments
• A drive to turn measurement into improvement: closing the loop from signals to changes that move the numbers
• Solid AI research and software engineering skills
• Strong communication skills and excitement to work on a small, fast-paced team
• A drive to get your work into the hands of real users