paulpierre / markdown-crawlerLinks
A multithreaded πΈοΈ web crawler that recursively crawls a website and creates a π½ markdown file for each page, designed for LLM RAG
β422Updated last year
Alternatives and similar repositories for markdown-crawler
Users that are interested in markdown-crawler are comparing it to the libraries listed below
Sorting:
- HTML to Markdown converter and crawler.β608Updated last year
- Parse PDFs into markdown using Vision LLMsβ455Updated 3 months ago
- Yet another open source Perplexityβ460Updated last year
- β90Updated last year
- 90% of what you need for LLM app development. Nothing you don't.β266Updated 4 months ago
- Easily deployable π API to convert PDF to markdown quickly with high accuracy.β931Updated last year
- Super performant RAG pipelines for AI apps. Summarization, Retrieve/Rerank and Code Interpreters in one simple API.β384Updated last year
- β243Updated 6 months ago
- β‘Chat with GitHub Repo Using 200k context window of Claude instead of RAG!β‘β171Updated last year
- β199Updated last week
- ScribeWizard: Generate organized notes from audio using Groq, Whisper, and Llama3β501Updated 4 months ago
- SearchGPT / Perplexity Pages clone, but personalised for you.β247Updated last year
- The simplest open-source implementation of perplexity.aiβ320Updated 11 months ago
- GPT based autonomous agent designed to create personalized newspapers tailored to user preferences.β1,443Updated last year
- β507Updated last year
- β205Updated 2 years ago
- π This is an adapted version of Jina AI's Reader for local deployment using Docker. Convert any URL to an LLM-friendly input with a simpβ¦β270Updated 5 months ago
- A cool AI Diagram generator from a given topic, that streams the partial diagrams from the incomplete JSONs during generation. Built usinβ¦β217Updated last year
- An experimental UI for text-to-knowledge-graph generationβ780Updated last year
- Structured information extraction from documentsβ320Updated last year
- Effortlessly record, transcribe, and summarize meetings with this user-friendly desktop utility powered by OpenAI's Whisper and GPT-3.5-tβ¦β187Updated 2 years ago
- Lightweight, performant, deep table extractionβ520Updated 5 months ago
- An innovative open-source Code Interpreter with (GPT,Gemini,Claude,LLaMa) models.β274Updated 7 months ago
- Clone of https://r.jina.ai which is deployable locallyβ50Updated last year
- A Function Calls Proxy for Groq, the fastest AI alive!β206Updated last year
- Summarize and query from a lot of heterogeneous documents. Any LLM provider, any filetype, advanced RAG, advanced summaries, scriptable, β¦β499Updated this week
- Easy to deploy.A cloud service for python code interpreter sandbox for Code-Interpreter.β57Updated last year
- Social and customizable AI writing assistant! βοΈβ258Updated 6 months ago
- Excel spreadsheet crawler and table parser for data extraction and queryingβ164Updated 10 months ago
- Command your browser with GPTβ422Updated last month