Applied AI Researcher, Benchmarking
Distyl AI · San Francisco · New York
Applied AIremote$150k–$250k
At a glance
Highlights
- Design evaluation frameworks that define how AI progress is measured.
- Build benchmarks reflecting real-world complexity and operational impact.
- Shape industry-wide standards for evaluating intelligent systems.
What they offer
- Meaningful equity
- 100% medical, dental, and vision coverage for employee and dependents
- Flexible time off
- 401(k), HSA, FSA, commuter accounts and financial coaching
- Wellness, fitness, mental well-being and Carrot fertility benefits
- Complimentary in-office lunches and snacks
- Access to state-of-the-art AI models and tools
- Ownership of high-impact projects across top enterprises
Ideal candidate
Creative researcher with a strong track record who lives AI-native daily and is bored by traditional research rails. You want to redefine enterprise software use and prove impact through demos, not theory.
Requirements
- Experience designing and running evaluations, benchmarks, test suites, or experimental frameworks
- Statistical and analytical rigor with fair, reproducible experiments
- Experience building with models including compound AI systems and agentic techniques
- Proven track record of research results
- Daily use of AI tools to accelerate workflow
- Strong programming and data analysis skills for prototyping and experiments
- Bias towards showing vs telling with real demos
- remote policy
- Hybrid, 3+ days per week in-office (Tuesday-Thursday)
Lab profile
About Distyl AI
Applied AI company rearchitecting critical enterprise operations into AI-native systems.
What they build
- AI-native operations technology
Known for
- Applied AI research and deployment
- Enterprise operations transformation
- Work across telecom, healthcare, insurance, manufacturing
Posted · Last seen