Member of Technical Staff - RL Inference

Highlights

• Design and optimize the inference stack for RL workloads at all scales.
• Analyze and resolve performance bottlenecks in large-scale RL systems.
• Help create AI systems that accurately understand the universe.

What they offer

• equity
• comprehensive medical, vision, and dental coverage
• 401(k) retirement plan
• short & long-term disability insurance
• life insurance

Ideal candidate

Hands-on engineer who thrives on curiosity, hard problems, and engineering excellence. Brings strong ownership, prioritization, and clear communication to a small, flat mission-driven team.

Requirements

• Experience in building, debugging, and optimizing efficiency of large-scale distributed systems
• Experience in LLM inference
• Proficiency in programming languages such as Python, C++ and/or Rust; frameworks such as PyTorch, Jax, CUDA
• Willingness to dive deep and solve hardcore problems at all levels of the stack
• Strong knowledge in quantization and numerics in LLM inference and training
• Experience in developing inference engines, e.g. SGLang, vLLM