Research, Post-Training Evals
Thinking Machines Lab · San Francisco
CHECKED 13H AGO
Frontier labonsite$350k–$475k
At a glance
Highlights
- Create internal evals and research signals for frontier model capabilities.
- Build agentic eval environments, harnesses and user simulators.
- Develop usability evals measuring real usefulness in research workflows.
What they offer
- health, dental, and vision benefits
- unlimited PTO
- paid parental leave
- relocation support as needed
Ideal candidate
A research-minded evaluator who cares about trustworthy measurement and real-world usefulness, collaborating across teams to turn ambiguous model behavior into reliable signals for training.
Requirements
- Bachelor's degree or equivalent experience in Computer Science, Machine Learning, Physics, Mathematics, or related discipline
- Experience designing, building, or analyzing evaluations, benchmarks, datasets, graders, or measurement systems
- Strong written and verbal communication skills with ability to collaborate across research and engineering teams
- visa sponsorship
- We sponsor visas
Lab profile
About Thinking Machines Lab
Builds frontier AI that extends human will and judgment through customizable models and interfaces.
What they build
- Inkling frontier models
- Tinker model customization
- Human-AI communication interfaces
Known for
- Frontier model training
- Post-training and reinforcement learning
- Evaluation infrastructure
- GPU supercomputing and reliability