doc-scraper

Crawl documentation sites into local Markdown or JSONL corpora and serve them with offline BM25 search, page reads, freshness checks and crawl diffs.

#547 by GitHub starsDocumentationChecked 2026-11-02

What it connects

Crawl documentation sites into local Markdown or JSONL corpora and serve them with offline BM25 search, page reads, freshness checks and crawl diffs.

Registry listing — description sourced from the publisher's entry in an awesome-list. Setup, compatibility and requirements are not verified; see the repository.

Source: https://github.com/Sriram-PR/doc-scraper · ★ 108 on the source repo

Setup instructions and compatibility are compiled from publisher docs and community reports, not hands-on testing, unless a step is marked Tested. Check the source before relying on a setup.