markcrawl

Crawl websites into clean Markdown, search pages and extract structured data with LLMs for web research and RAG pipelines.

#2178 by GitHub starsDocumentationChecked 2026-11-02

What it connects

Crawl websites into clean Markdown, search pages and extract structured data with LLMs for web research and RAG pipelines.

Registry listing — description sourced from the publisher's entry in an awesome-list. Setup, compatibility and requirements are not verified; see the repository.

Source: https://github.com/AIMLPM/markcrawl · ★ 5 on the source repo

Setup instructions and compatibility are compiled from publisher docs and community reports, not hands-on testing, unless a step is marked Tested. Check the source before relying on a setup.