Member of Technical Staff - Data Ingestion Engineer

Highlights

• Build ingestion systems turning open web into corpora for frontier models.
• Run experiments linking crawling strategies to model performance gains.
• Develop specialized crawlers for high-priority data sources at PB scale.

What they offer

• Top-tier salary and equity with stock options for all employees
• Comprehensive medical, dental, vision and life insurance plus wellness allowance
• Lunch and dinner provided daily in the office
• 22 weeks paid parental leave and unlimited PTO in US, 30 days in UK
• Regular off-sites, happy hours and team celebrations

Ideal candidate

A curious distributed-systems builder excited by how training data shapes model capabilities. You thrive in hybrid research-engineering roles and iterate fast with researchers based on measurable impact.

Requirements

• Experience building web crawling, data ingestion, or large-scale data acquisition systems using Ray, Beam, Spark, or similar
• Familiarity with how LLMs are trained and evaluated and intuition for useful training data
• Comfortable working with very large datasets (multi-TB to PB scale) building observable, testable systems
• Comfortable designing experiments and using data to guide system improvements
• Excellent communication skills and ability to explain tradeoffs clearly
• Curious about how training data influences model capabilities and iterate on downstream impact
• Able to collaborate across researchers, infra, operations and external partners