Member of Technical Staff, Pre-Training Data

Highlights

• Build the pre-training data pipeline powering Cohere's frontier language models.
• Run data ablations and design data mixtures to boost model performance.
• Bridge research and engineering to improve training throughput and efficiency.

What they offer

• Weekly lunch stipend
• Full health and dental benefits including mental health budget
• RRSP matching, 401K, Pension Scheme
• 100% parental leave top-up for up to 6 months
• 6 weeks of paid vacation
• Education and enrichment benefits
• $500 home office stipend
• Co-working benefit and annual company offsite

Ideal candidate

An ML engineer passionate about transforming raw data into frontier-model capabilities, thriving at the intersection of research and engineering to tackle large-scale data challenges.

Requirements

• Strong software engineering skills with proficiency in Python and experience building data pipelines
• Familiarity with curriculum learning, data mixing and data attribution
• Familiarity with data processing frameworks such as Apache Spark, Apache Beam, Pandas or similar
• Experience working with large-scale datasets including web, code and multilingual corpora
• Knowledge of data quality assessment techniques and experimentation with data mixtures
• Passion for bridging research and engineering to solve complex data challenges in AI training