Skip to content
← Arena (formerly LMArena)

Machine Learning Engineer

Arena (formerly LMArena) · SF Bay Area

Infrastructureremotesenior
Apply on the lab’s site ↗

At a glance

Highlights

  • Scale core infrastructure powering real-world AI evaluation for millions monthly.
  • Shape how frontier AI models are benchmarked across coding, creative, and work tasks.
  • Own data, training, and eval pipelines for scalable evaluation platform.

What they offer

  • Competitive compensation aligned to markets
  • Comprehensive health benefits including medical, dental and vision
  • Additional wellness support programs
  • Opportunity to work on cutting-edge AI with small mission-driven team

Ideal candidate

Self-motivated builder who loves owning systems end-to-end and shipping quality products. Passionate about rigorous, human-centered AI evaluation and thriving in small, mission-driven teams.

Requirements

  • Strong programming skills across full stack in recommendation or LLM stack
  • Experience in deep learning, language models or reward model training
  • Experience with LLM fine-tuning, prompt engineering and function calling
  • 4+ years of industry experience or relevant projects
  • Prior experience working on anti-abuse
  • Solid understanding of statistics and methods for evaluating uncertainty
  • Self-motivated, takes ownership and passionate about shipping quality products

Lab profile

About Arena (formerly LMArena)

Platform for evaluating AI models in the real world via crowdsourced preferences.

What they build

  • Arena real-world AI evaluation platform

Known for

  • Real-world model evaluation
  • Large-scale crowdsourced human preferences
  • Transparent benchmarking

Key facts

  • Founded by UC Berkeley SkyLab researchers
  • Tens of millions of monthly users
More about Arena (formerly LMArena) →
Apply on the lab’s site ↗

Posted · Last seen