Senior / Staff Software Engineer — AI / ML
Snorkel AI · New York City, NY (Hybrid) · San Francisco, CA (Hybrid)
Infrastructurehybridsenior / staff$208k–$315k
At a glance
Highlights
- Cut cost of long-horizon agent evals with adaptive sampling and early stopping.
- Route eval and judge calls to cheapest model that clears quality bar.
- Build difficulty models that predict task hardness before any rollout.
Ideal candidate
A proactive ML engineer who owns prototypes to production and obsesses over rigorous measurement and cost-efficient evals. You love turning research ideas into reusable systems and shaping a new discipline with researchers and engineers.
Requirements
- 5+ years building production ML or software systems, with end-to-end ownership from prototype to production
- Hands-on experience running LLM or ML workloads in production, and comfort reasoning about non-deterministic systems
- Deep grounding in statistics and experimentation: experiment design, hypothesis testing, sampling, and confidence intervals
- Strong Python and software engineering fundamentals, including testing, code review, and system design
- Experience designing evaluations and interpreting results rigorously
- A habit of finding high-impact problems before they are assigned, and clear communication with researchers, engineers, and business partners
Lab profile
About Snorkel AI
Frontier AI data lab building datasets, benchmarks, and evals for frontier and agentic AI.
What they build
- Datasets for frontier AI
- Benchmarks and evals
- Custom AI data solutions
Known for
- Research-driven AI data development
- Combines technology with expert data development
- Works with leading AI labs and enterprises
Key facts
- Founded in 2019
- Spun out of Stanford AI Lab
Posted · Last seen