Senior/Staff Evaluation Data Analyst (Agentic Search)
Nebius · London, United Kingdom
InfrastructureonsiteSenior/Staff
At a glance
Highlights
- Own end-to-end quality for search built to ground AI agents in real-world data.
- Build datasets, benchmarks and pipelines guiding search development and launches.
- Diagnose failures and drive improvements with engineers and product managers.
What they offer
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams
Ideal candidate
Analytical builder who thrives in ambiguity and owns quality end-to-end. You blend engineering, statistics and product judgment and care about grounding AI agents in fresh, accurate data.
Requirements
- Substantial hands-on experience designing and building evaluation or quality measurement systems for complex products
- Track record of owning ambiguous problems from framing through implementation to measurable improvement
- Strong Python skills and engineering mindset for reliable, maintainable pipelines and tools
- Solid foundation in mathematical statistics and experience with experimental design, sampling and measurement bias
- Strong analytical judgment on what metrics capture and whether improvements matter to users
- Ability to reason across user needs, product behavior and technical systems into actionable evaluations
- Strong communication and collaboration skills to influence technical and product decisions
- Independence to make progress where requirements and definitions of success are still evolving
Lab profile
About Nebius
Full-stack AI cloud platform for data, model training, and production deployment at scale.
What they build
- Full-stack AI cloud platform
Known for
- Large-scale GPU orchestration
- Inference optimization
- Efficient LLM inference and model optimization
- Physical AI infrastructure
Posted · Last seen