Research Scientist, Frontier Risk Evaluations
Scale AI · San Francisco, CA; New York, NY · San Francisco, CA
CHECKED 14H AGO
Infrastructureonsite
At a glance
Highlights
- Design harnesses testing AI agents for dangerous capabilities and risks.
- Publish evaluation methods and reports guiding global AI policy decisions.
- Collaborate with governments and labs to mitigate advanced AI risks.
What they offer
- Base salary, equity and benefits
- Comprehensive health, dental and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
Ideal candidate
Mission-driven researcher who loves rapid ML prototyping and clear communication. Passionate about AI safety and translating technical findings to guide policymakers.
Requirements
- Commitment to promoting safe, secure and trustworthy AI deployments
- Practical experience conducting collaborative technical research
- Comfortable building ML pipelines, evaluation harnesses and prototypes
- Track record of published research in machine learning, particularly generative AI
- At least 3 years experience with sophisticated ML problems in research or product
- Strong written and verbal communication skills for cross-functional work
- hiring process
- Research interviews assess practical ML prototyping and debugging, grasp of research concepts, and culture fit; no LeetCode-style questions.
Lab profile
About Scale AI
AI data foundry providing high-quality data for training, fine-tuning, and evaluating AI systems.
What they build
- Training, fine-tuning, and evaluation data for frontier models
- Multimodal and coding data for audio, image, video and world models
- Custom AI applications for enterprise and global public sector
Known for
- Leading data partner for frontier model developers
- Trusted across enterprise, defense and public sector
- Depth in multimodal, coding and physical AI
- End-to-end capability from strategy to delivery and evaluation
Key facts
- Founded in 2016
- Headquartered in San Francisco, California
- Private company backed by Accel, Founders Fund, Index Ventures, Nvidia and Meta