Pre-training Data Infrastructure Engineer

Highlights

• Build end-to-end pipelines turning web-scale corpora into training datasets.
• Help develop next-generation large language models for safe AI systems.
• Design reproducible, traceable data infrastructure for LLM pretraining.

What they offer

• Competitive compensation and benefits
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• Collaborative office space

Ideal candidate

A systems-minded engineer with deep distributed systems experience who thrives in ambiguity, takes ownership, and is motivated by building safe, ethical AI.

Requirements

• 5+ years of experience outside of internships
• Strong software engineering skills building high-throughput fault-tolerant distributed systems
• Hands-on experience with distributed computing frameworks, particularly Apache Spark
• Excellent problem-solving skills and attention to detail
• Strong communication skills and ability to work collaboratively
• Advanced degree in Computer Science or related field
• Experience with language model training infrastructure
• Background in Data Infrastructure, MLOps, or ML infrastructure
• Bachelor's degree or equivalent combination of education, training and experience