Software Engineer, Web Crawling
Exa · San Francisco, California
Applied AIonsite$180k–$350k
At a glance
Highlights
- Build distributed crawler handling 100M+ pages per day at Google scale.
- Power search for Cursor, Cognition, HubSpot and 400k developers.
- Build perfect search over all world's information beyond Google.
What they offer
- Premium healthcare benefits (medical, dental, vision)
- Fertility benefits
- 16 weeks of fully paid parental leave
- Monthly wellness stipend
- Equity
Ideal candidate
You are obsessed with optimizing large-scale systems to an exceptional degree and care deeply about surfacing high-quality knowledge for the world. You thrive ramping quickly on massive-scale crawling challenges.
Requirements
- Experience building and scaling web crawlers or able to ramp up very quickly
- Experience with a high performance language such as C++ or Rust
- Familiarity with TypeScript, Playwright, modern web design, and CDP
- Comfortable optimizing a system to an exceptional degree
- visa sponsorship
- Visa sponsorship available, including STEM OPT, OPT, H1B, O1, E3
Lab profile
About Exa
Applied AI lab building perfect search over all world's information for the AI era.
What they build
- Search engine for AIs
- Search API
Known for
- Massive-scale web crawling infrastructure
- State-of-the-art embedding models
- High-performance vector databases
Key facts
- SF-based team of ~100
- Raised $350M total
- $250M Series C at $2.2B valuation
Posted · Last seen