Member of Technical Staff - Mid-training

Highlights

• Scale synthetic coding data to trillions of tokens with verification.
• Distill flagship models into flash models via synthetic data.
• Optimize mid-training mixtures to boost the ceiling for RL.

What they offer

• equity
• comprehensive medical, vision, and dental coverage
• 401(k) retirement plan
• short & long-term disability insurance
• life insurance
• discounts and perks

Ideal candidate

A curious, hands-on builder who thrives in small, flat teams, takes initiative, and cares deeply about engineering excellence and advancing understanding of the universe.

Requirements

• Expertise in ML and large model scaling, with familiarity across all kinds of scaling laws.
• Strong ability to design ML experiments.
• Familiarity with state-of-the-art techniques for curating AI training data for text, image, audio, and video modalities.
• Strong engineering abilities in Spark, Ray, and other frameworks for large-scale data processing.