Machine Learning Engineer
Arena (formerly LMArena) · SF Bay Area
Infrastructureremotesenior
At a glance
Highlights
- Scale core infrastructure powering real-world AI evaluation for millions monthly.
- Shape how frontier AI models are benchmarked across coding, creative, and work tasks.
- Own data, training, and eval pipelines for scalable evaluation platform.
What they offer
- Competitive compensation aligned to markets
- Comprehensive health benefits including medical, dental and vision
- Additional wellness support programs
- Opportunity to work on cutting-edge AI with small mission-driven team
Ideal candidate
Self-motivated builder who loves owning systems end-to-end and shipping quality products. Passionate about rigorous, human-centered AI evaluation and thriving in small, mission-driven teams.
Requirements
- Strong programming skills across full stack in recommendation or LLM stack
- Experience in deep learning, language models or reward model training
- Experience with LLM fine-tuning, prompt engineering and function calling
- 4+ years of industry experience or relevant projects
- Prior experience working on anti-abuse
- Solid understanding of statistics and methods for evaluating uncertainty
- Self-motivated, takes ownership and passionate about shipping quality products
Lab profile
About Arena (formerly LMArena)
Platform for evaluating AI models in the real world via crowdsourced preferences.
What they build
- Arena real-world AI evaluation platform
Known for
- Real-world model evaluation
- Large-scale crowdsourced human preferences
- Transparent benchmarking
Key facts
- Founded by UC Berkeley SkyLab researchers
- Tens of millions of monthly users
Posted · Last seen