Software Engineer - ML Infrastructure
Arena (formerly LMArena) · SF Bay Area
Infrastructureonsitesenior$150k–$350k
At a glance
Highlights
- Architect scalable low-latency model inference infrastructure at scale.
- Build RL post-training infrastructure powering frontier AI evaluations.
- Design automated evaluation frameworks delivering rapid researcher feedback.
What they offer
- Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs
- Opportunity to work on cutting-edge AI with a small, mission-driven team
Ideal candidate
Performance-obsessed builder with deep ML infrastructure background who thrives in fast-moving, high-ownership environments and loves partnering with researchers to advance state-of-the-art AI.
Requirements
- 5+ years of experience in software engineering, with a focused background in ML infrastructure, distributed systems, or large-scale data platform engineering
- Hands-on experience with PyTorch, model serving engines, and distributed training frameworks
- Solid background in reinforcement learning (RL) post-training infrastructure, RLHF, or automated model evaluation pipelines
- Proven ability to design and operate low-latency, high-throughput, and fault-tolerant distributed services at scale
- Strong foundation in systems design, GPU cluster utilization, and performance tuning
- Thrive in a fast-paced, high-ownership environment working closely with ML researchers
Lab profile
About Arena (formerly LMArena)
Platform for evaluating AI models in the real world via crowdsourced preferences.
What they build
- Arena real-world AI evaluation platform
Known for
- Real-world model evaluation
- Large-scale crowdsourced human preferences
- Transparent benchmarking
Key facts
- Founded by UC Berkeley SkyLab researchers
- Tens of millions of monthly users
Posted · Last seen