Software Engineer, Pretraining

Highlights

• Build data pipelines turning raw web-scale data into training tokens.
• Scale web crawling to discover and parse high-quality open-web content.
• Run experiments proving data quality improves loss and model evals.

Ideal candidate

High-slope, high-ownership infrastructure builder who moves fast, debates ideas, and ships. Truth-seeking and creative, excited to own systems that shape frontier coding model quality.

Requirements

• Strong infrastructure or data platform background, ideally with outlier depth somewhere
• High-slope engineer who has moved unusually fast or brings deep domain experience
• Able to architect and ship end-to-end with high ownership and debug complex systems independently
• Strong intuitions about large-scale distributed systems
• Excited to learn how pretraining data shapes model quality