paulpierre / markdown-crawler

A multithreaded πŸ•ΈοΈ web crawler that recursively crawls a website and creates a πŸ”½ markdown file for each page, designed for LLM RAG
β˜†311Updated 3 months ago

Related projects β“˜

Alternatives and complementary repositories for markdown-crawler