Member of Technical Staff - Engineering Lead, Data Ingestion

Highlights

• Lead ingestion layer turning open web and licensed corpora into training datasets.
• Tie crawling and extraction decisions to measurable downstream model impact.
• Own web crawl, pipelines, and data lakes powering frontier open models.

What they offer

• Top-tier compensation with salary and equity
• Stock options for all contributors
• Comprehensive medical, dental, vision, life and wellness allowance
• Lunch and dinner provided in the office daily
• 22 weeks paid parental leave for all new parents
• Unlimited paid time off in the U.S. and 30 days in the U.K.
• Regular off-sites, happy hours, and team celebrations

Ideal candidate

Hands-on data or infra leader who loves mentoring engineers and owning web-scale systems. You care about open AI and connecting data decisions to real model improvements.

Requirements

• Experience building, mentoring, and growing data or infrastructure engineering teams while staying technically hands-on
• Deep experience building web-scale data acquisition or ingestion systems at multi-TB to PB scale
• Strong coding ability and credibility to earn technical trust of a strong team
• Deep expertise in web crawling and acquisition, large-scale extraction and ingestion pipelines, or data lakes and corpus storage
• Fluency with distributed compute, orchestration, Parquet, JSONL, WARC, and object-store data-lake architectures
• Familiarity with how LLMs are trained and evaluated and intuition for useful training data
• Ability to guide strategy across concurrent data campaigns and partner with research, vendors, and legal