Senior Software Engineer, Agent Oversight
Scale AI · San Francisco, CA · New York, NY
Infrastructureonsitesenior
At a glance
Highlights
- Build platform infrastructure to observe, evaluate and improve production agents.
- Design observability tooling and evaluation harnesses for agentic applications.
- Define dependable production-grade agentic AI for enterprise and government use.
Ideal candidate
Backend-oriented engineer with 4+ years owning platforms others build on who thrives in ambiguity. You care about reliable agentic AI in production and partnering with ML to turn evals into impact.
Requirements
- 4+ years professional software engineering experience with backend/distributed systems, APIs, and data pipelines
- Hands-on experience building production software for ML/LLM products or platforms
- Working knowledge of LLM/ML behavior in production including evals, failure modes, and data quality
- Experience partnering with ML engineers to turn prototypes and eval loops into reliable platforms
- Experience building infrastructure or platforms other engineering teams build on
- Track record owning features end-to-end from design through production
- Comfortable operating in ambiguous, fast-changing domains
Lab profile
About Scale AI
AI data foundry providing high-quality data for training, fine-tuning, and evaluating AI systems.
What they build
- Training, fine-tuning, and evaluation data for frontier models
- Multimodal and coding data for audio, image, video and world models
- Custom AI applications for enterprise and global public sector
Known for
- Leading data partner for frontier model developers
- Trusted across enterprise, defense and public sector
- Depth in multimodal, coding and physical AI
- End-to-end capability from strategy to delivery and evaluation
Key facts
- Founded in 2016
- Headquartered in San Francisco, California
- Private company backed by Accel, Founders Fund, Index Ventures, Nvidia and Meta
Posted · Last seen