Skip to content
← Nebius

Senior/Staff Evaluation Data Analyst (Agentic Search)

Nebius · London, United Kingdom

InfrastructureonsiteSenior/Staff
Apply on the lab’s site ↗

At a glance

Highlights

  • Own end-to-end quality for search built to ground AI agents in real-world data.
  • Build datasets, benchmarks and pipelines guiding search development and launches.
  • Diagnose failures and drive improvements with engineers and product managers.

What they offer

  • Competitive compensation
  • Career growth and learning opportunities
  • Flexibility and ownership
  • Collaborative and innovative culture
  • Opportunity to work on impactful AI projects
  • International environment and talented teams

Ideal candidate

Analytical builder who thrives in ambiguity and owns quality end-to-end. You blend engineering, statistics and product judgment and care about grounding AI agents in fresh, accurate data.

Requirements

  • Substantial hands-on experience designing and building evaluation or quality measurement systems for complex products
  • Track record of owning ambiguous problems from framing through implementation to measurable improvement
  • Strong Python skills and engineering mindset for reliable, maintainable pipelines and tools
  • Solid foundation in mathematical statistics and experience with experimental design, sampling and measurement bias
  • Strong analytical judgment on what metrics capture and whether improvements matter to users
  • Ability to reason across user needs, product behavior and technical systems into actionable evaluations
  • Strong communication and collaboration skills to influence technical and product decisions
  • Independence to make progress where requirements and definitions of success are still evolving

Lab profile

About Nebius

Full-stack AI cloud platform for data, model training, and production deployment at scale.

What they build

  • Full-stack AI cloud platform

Known for

  • Large-scale GPU orchestration
  • Inference optimization
  • Efficient LLM inference and model optimization
  • Physical AI infrastructure
More about Nebius →
Apply on the lab’s site ↗

Posted · Last seen