Software Engineer, Web Crawling
Exa · Singapore
Applied AIonsite$70k–$232k
At a glance
Highlights
- Build Google-scale distributed crawler handling 100M+ pages per day.
- Create intelligent crawl scheduling and prioritization for maximum coverage.
- Power search for Cursor, Cognition, HubSpot and 400,000 developers.
What they offer
- Premium healthcare benefits (medical, dental, vision)
- Fertility benefits
- 16 weeks of fully paid parental leave for all new parents
- Monthly wellness stipend
- Equity
Ideal candidate
Experienced systems builder obsessed with optimization and large-scale infrastructure who cares deeply about finding high-quality knowledge to power AI's access to world information.
Requirements
- Extensive experience building and scaling web crawlers, or ability to ramp up very quickly
- Experience with high performance language such as C++ or Rust
- Familiar with TypeScript, Playwright, modern web design, CDP (Chrome DevTools Protocol)
- Comfortable optimizing a system to an exceptional degree
- Cares about finding high quality knowledge
- remote policy
- In-person in Singapore
- visa sponsorship
- Happy to sponsor international candidates
Lab profile
About Exa
Applied AI lab building perfect search over all world's information for the AI era.
What they build
- Search engine for AIs
- Search API
Known for
- Massive-scale web crawling infrastructure
- State-of-the-art embedding models
- High-performance vector databases
Key facts
- SF-based team of ~100
- Raised $350M total
- $250M Series C at $2.2B valuation
Posted · Last seen