Member of Technical Staff - Engineering Lead, Data Acquisition
Reflection AI · San Francisco, CA · London · New York, NY
Frontier labonsitelead
At a glance
Highlights
- Lead ingestion layer turning open web and licensed sources into training corpora.
- Own web crawl, extraction pipelines and versioned data lakes at PB scale.
- Shape model strengths and safety through what you crawl, extract and keep.
What they offer
- Salary and equity with stock options for all contributors
- Comprehensive medical, dental, vision and life insurance plus wellness allowance
- Lunch and dinner provided in the office daily
- 22 weeks paid parental leave for all new parents including adoptive journeys
- Unlimited PTO in the US and 30 days in the UK plus off-sites and celebrations
Ideal candidate
Hands-on engineering leader who loves building web-scale data systems and growing strong teams. You stay close to the stack, sweat ingestion details, and care how data choices shape open frontier models.
Requirements
- Experience building, mentoring and growing data or infrastructure engineering teams while staying technically hands-on
- Deep experience building web-scale data acquisition or ingestion systems at multi-TB to PB scale
- Strong coding ability with credibility to earn technical trust of a strong team
- Deep expertise in web crawling, large-scale extraction pipelines, or data lakes and corpus delivery
- Fluency with Ray, Beam, Spark, Airflow, Prefect, Parquet, JSONL, WARC and object stores
- Ability to drive concurrent data campaigns with research, vendors and legal within licensing constraints
- visa sponsorship
- Visa sponsorship available, including long-term immigration support
Lab profile
About Reflection AI
Research lab making intelligence open and accessible for everyone to use, customize, and build on.
What they build
- Open foundation models
- Aligned general agents
- Enterprise AI deployments
Known for
- Frontier model pre-training
- Post-training and alignment
- Distributed training infrastructure
- Secure cloud platform foundations
Posted · Last seen