Software Engineer, Evaluation Platform / Infra
Thinking Machines Lab · San Francisco · New York
Frontier labonsite$300k–$350k
At a glance
Highlights
- Build end-to-end platform for authoring and running model evaluations at scale.
- Turn evaluation results into insights guiding frontier AI research decisions.
- Make model evaluations reproducible with versioning and provenance tracking.
What they offer
- generous health, dental, and vision benefits
- unlimited PTO
- paid parental leave
- relocation support as needed
Ideal candidate
A product-minded platform builder with 2+ years of experience who loves partnering with researchers to turn messy evaluation workflows into reliable, self-serve systems.
Requirements
- Bachelor's degree or equivalent practical experience in computer science, engineering, machine learning, or related field
- Two years of post-grad work experience as a software engineer or ML engineer, exclusive of internships
- Hands-on experience building or maintaining evaluations, benchmarks, graders, or model-quality systems
- Strong software engineering fundamentals and experience building reliable, maintainable systems
- Proficiency in at least one backend programming language
- Experience with databases, data pipelines, distributed systems, or other data-intensive infrastructure
- Comfort working across the stack and owning projects from discovery through deployment
- Experience collaborating with cross-functional partners and subject-matter experts
- visa sponsorship
- We sponsor visas
Lab profile
About Thinking Machines Lab
Builds frontier AI that extends human will and judgment through customizable models and interfaces.
What they build
- Inkling frontier models
- Tinker model customization
- Human-AI communication interfaces
Known for
- Frontier model training
- Post-training and reinforcement learning
- Evaluation infrastructure
- GPU supercomputing and reliability
Posted · Last seen