Research Engineer, Infrastructure, Inference

Highlights

• Scale systems powering frontier AI models for real-world applications.
• Make inference faster, cheaper, and more reliable at massive scale.
• Bring cutting-edge AI models from research into production.

What they offer

• Generous health, dental, and vision benefits
• Unlimited PTO
• Paid parental leave
• Relocation support as needed

Ideal candidate

Collaborative, action-biased engineer excited by large-scale AI infrastructure who thrives partnering with researchers to turn novel models into fast, reliable production systems.

Requirements

• Bachelor's degree or equivalent experience in computer science, engineering, or similar
• Understanding of deep learning frameworks and underlying system architectures
• Experience with inference serving systems optimized for throughput and latency
• Thrive in highly collaborative environment with cross-functional partners
• Bias for action with initiative to work across stacks and teams to ship
• Strong engineering skills with performant, maintainable code and debugging in complex codebases
• Experience training or supporting large-scale language models with hundreds of billions of parameters or more
• Understanding of distributed compute systems, GPU parallelism, and hardware-aware optimizations
• Contributions to open-source ML or systems infrastructure projects
• Track record of improving research productivity through infrastructure design