Member of Technical Staff - Research
Vals AI · San Francisco
Applied AIonsite$130k–$185k
At a glance
Highlights
- Design novel benchmarks that measure real-world LLM capabilities.
- Collaborate with major foundation model labs on frontier evaluations.
- Publish research shaping the global standard for AI evaluation.
What they offer
- Highly competitive salary and meaningful ownership
- Relocation and transportation support
- Health/dental insurance coverage
- Lunch and dinner provided, free snacks/coffee/drinks
- Unlimited PTO
- $1,500 housing stipend (within one-mile radius)
- Opportunity to publish and present your work
Ideal candidate
Research-minded builder with ML/NLP publications who loves rigorous evaluation and wants their benchmarks to directly shape how frontier labs build models.
Requirements
- Master's degree or PhD in Computer Science, NLP, Machine Learning, or related field
- Published papers in reputable venues (NeurIPS, ICML, ACL, EMNLP, etc.)
- Strong understanding of experimental design, statistical analysis, and evaluation frameworks
- Proficiency in Python for research and experimentation
- Ability to clearly communicate complex research ideas
- Experience working in research teams
Lab profile
About Vals AI
Builds expert-driven benchmarks and platform to evaluate LLMs for safety and enterprise use.
What they build
- LLM evaluation platform
- AI safety benchmarks
- Cybersecurity benchmarks
Known for
- LLM evaluation at scale
- AI safety benchmarking
- Cybersecurity benchmarking
- Expert-led scenario design
Posted · Last seen