Alternatives and similar repositories for markdown-crawler

Users that are interested in markdown-crawler are comparing it to the libraries listed below

• philschmid / clipper.js
  HTML to Markdown converter and crawler.
  ☆594Updated last year
• jjleng / sensei
  Yet another open source Perplexity
  ☆456Updated last year
• iamarunbrahma / vision-parse
  Parse PDFs into markdown using Vision LLMs
  ☆439Updated 3 weeks ago
• knowsuchagency / promptic
  90% of what you need for LLM app development. Nothing you don't.
  ☆264Updated 2 months ago
• adithya-s-k / marker-api
  Easily deployable 🚀 API to convert PDF to markdown quickly with high accuracy.
  ☆917Updated last year
• aurelio-labs / semantic-chunkers
  ☆238Updated 4 months ago
• Spryngtime / openai-load-balancer
  ☆89Updated last year
• Bklieger / ScribeWizard
  ScribeWizard: Generate organized notes from audio using Groq, Whisper, and Llama3
  ☆499Updated 2 months ago
• yoheinakajima / prettygraph
  An experimental UI for text-to-knowledge-graph generation
  ☆781Updated last year
• cognitivetech / ollama-ebook-summary
  LLM for Long Text Summary (Comprehensive Bulleted Notes)
  ☆599Updated 3 months ago
• alexfazio / OpenPlexity-Pages
  SearchGPT / Perplexity Pages clone, but personalised for you.
  ☆245Updated last year
• gkamradt / ChunkViz
  Visualize Different Text Splitting Methods
  ☆300Updated 10 months ago
• junruxiong / IncarnaMind
  Connect and chat with your multiple documents (pdf and txt) through GPT 3.5, GPT-4 Turbo, Claude and Local Open-Source LLMs
  ☆796Updated 8 months ago
• pengfeng / ask.py
  A simple Python program to implement the search-extract-summarize flow.
  ☆273Updated 4 months ago
• jw782cn / RepoChat-200k
  ⚡Chat with GitHub Repo Using 200k context window of Claude instead of RAG!⚡
  ☆169Updated last year
• clemlesne / scrape-it-now
  Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and outputs high-quality markdown content.
  ☆528Updated this week
• thiswillbeyourgithub / wdoc
  Summarize and query from a lot of heterogeneous documents. Any LLM provider, any filetype, advanced RAG, advanced summaries, scriptable, …
  ☆487Updated this week
• intergalacticalvariable / reader
  📚 This is an adapted version of Jina AI's Reader for local deployment using Docker. Convert any URL to an LLM-friendly input with a simp…
  ☆255Updated 3 months ago
• hargup / reader
  Clone of https://r.jina.ai which is deployable locally
  ☆48Updated last year
• hinthornw / promptimizer
  Prompt optimization scratch
  ☆863Updated 6 months ago
• haseeb-heaven / code-interpreter
  An innovative open-source Code Interpreter with (GPT,Gemini,Claude,LLaMa) models.
  ☆275Updated 5 months ago
• superagent-ai / super-rag
  Super performant RAG pipelines for AI apps. Summarization, Retrieve/Rerank and Code Interpreters in one simple API.
  ☆384Updated last year
• sarthakrastogi / graph-rag
  ☆274Updated last year
• FeatureBaseDB / DoctorGPT
  💻📚💡 DoctorGPT provides advanced LLM prompting for PDFs and webpages.
  ☆245Updated last year
• weavel-ai / Ape
  Your first AI prompt engineer
  ☆412Updated 4 months ago
• Unstructured-IO / unstructured-inference
  ☆197Updated this week
• alvin-r / databonsai
  clean & curate your data with LLMs.
  ☆490Updated last year
• poloclub / wordflow
  Social and customizable AI writing assistant! ✍️
  ☆253Updated 4 months ago
• sinaptik-ai / panda-etl
  No-code ETL and data pipelines with AI and NLP
  ☆317Updated 8 months ago
• myscale / ChatData
  ChatData 🔍 📖 brings RAG to real applications with FREE✨ knowledge bases. Now enjoy your chat with 6 million wikipedia pages and 2 milli…
  ☆178Updated 11 months ago