Research Engineer - Model Architectures

Highlights

• Design and rigorously test novel model architectures and training methodologies.
• Improve core capabilities like loss per flop and tackle key model bottlenecks.
• Partner with pre-training team to integrate insights into next-generation models.

What they offer

• Comprehensive medical, dental, vision, and FSA plans
• 401(k) plan
• Relocation and immigration support on a case-by-case basis
• In-office snacks and meals provided
• Unlimited PTO and company holidays

Ideal candidate

Curious, inventive researcher who loves understanding intelligence and testing bold ideas rigorously. Thrives taking projects from conception to write-up in fast-paced, collaborative teams.

Requirements

• Strong research taste and intuition
• Ability to take research from conception to execution to write-up
• Strong implementation and prototyping ability
• Ability to work well in a high-paced collaborative research setting
• Curiosity and joy in understanding intelligence
• Experience with long-term memory, RAG/retrieval, dynamic/adaptive computation, and alternative credit assignment
• Experience with reinforcement learning, control theory, and signal processing
• Understanding of modern training pipelines and GPU-efficient architecture design
• Strong grasp of rigorous experimental methodology and ablations
• High proficiency with PyTorch and Python
• Ability to ramp quickly in large pre-existing codebases
• Published ML research in respected venues
• Postgraduate degree in Computer Science, EE/EECS, Math, Physics or related scientific field