crw

Self-hostable web crawler and search API (fastCRW): scraping, crawling, site mapping and SearXNG-backed search.

#125 by GitHub starsDocumentationChecked 2026-11-02

What it connects

Self-hostable web crawler and search API (fastCRW): scraping, crawling, site mapping and SearXNG-backed search.

Registry listing — description sourced from the publisher's entry in an awesome-list. Setup, compatibility and requirements are not verified; see the repository.

Source: https://github.com/us/crw · ★ 1.2k on the source repo

Setup instructions and compatibility are compiled from publisher docs and community reports, not hands-on testing, unless a step is marked Tested. Check the source before relying on a setup.