Member of Technical Staff - Research, Cyber
Vals AI · San Francisco
Applied AIonsite$130k–$185k
At a glance
Highlights
- Design next-gen benchmarks assessing real-world cyber capabilities of LLMs.
- Define the standard for evaluating LLMs on real-world security tasks.
- Publish findings and shape how major labs develop foundation models.
What they offer
- Equity ownership
- Relocation and transportation support
- Health and dental insurance coverage
- Lunch and dinner provided, snacks/coffee/drinks
- Unlimited PTO
- $1,500 housing stipend within one-mile radius
- Opportunity to publish and present work
Ideal candidate
Hands-on security researcher who loves rigorous measurement and already uses LLMs in security work. Fast-learning, high-ownership collaborator eager to define how AI cyber capabilities are evaluated.
Requirements
- Hands-on security experience as engineer, pentester, red teamer or vulnerability researcher
- Strong grounding in operating systems, cloud infrastructure and networking
- Interest in rigorous measurement; experience building cyber evals, CTFs or benchmarks
- Experience using LLMs in security work
- Ability to communicate complex research to technical and non-technical audiences
- Experience working in research teams and integrating feedback
Lab profile
About Vals AI
Builds expert-driven benchmarks and platform to evaluate LLMs for safety and enterprise use.
What they build
- LLM evaluation platform
- AI safety benchmarks
- Cybersecurity benchmarks
Known for
- LLM evaluation at scale
- AI safety benchmarking
- Cybersecurity benchmarking
- Expert-led scenario design
Posted · Last seen