A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG
☆429Aug 13, 2024Updated last year
Alternatives and similar repositories for markdown-crawler
Users that are interested in markdown-crawler are comparing it to the libraries listed below
Sorting:
- A simple and streamlined Python script to extract and filter links from a remote HTML resource.☆24Jan 12, 2025Updated last year
- Browser automation for creating new pages in WordPress☆13Jun 7, 2025Updated 9 months ago
- An open source framework for Retrieval-Augmented System (RAG) uses semantic search helps to retrieve the expected results and generate h…☆22Nov 21, 2025Updated 3 months ago
- word4num is a versatile tool for encoding numbers into words, applicable for geolocation, phone numbers, postcodes, IPv4 addresses, and m…☆12Oct 9, 2024Updated last year
- A tool to automatically create and run your Python scripts in a virtual environment with installed dependencies☆19Nov 25, 2025Updated 3 months ago
- ☆12Nov 5, 2024Updated last year
- Empower your script with auto_venv: Say Goodbye to Manual Setup or Install!☆21Jun 20, 2024Updated last year
- Wave Partial Differential Equation Solver in Python☆14Jun 5, 2024Updated last year
- Examples of vector DB indexing and query with various vector databases.☆13Feb 12, 2025Updated last year
- Incredibly descriptive audiovisual summaries for videos☆41Aug 2, 2024Updated last year
- A fast tool to convert any website into LLM-ready markdown data. Built by https://supermemory.ai☆1,824Jul 21, 2024Updated last year
- Cookbook for Crafting Good Code☆57Mar 19, 2024Updated last year
- Rust implementation of Surya☆65Mar 1, 2025Updated last year
- Keep your configuration files in sync☆16Jan 6, 2026Updated 2 months ago
- Add Google and Python documentation links to the bottom of exceptions.☆28Nov 4, 2023Updated 2 years ago
- Extract structured text from pdfs quickly☆670Jun 11, 2025Updated 8 months ago
- Creating Intelligent Terminal Apps with ChatGPT and LLM Models☆31Jul 9, 2023Updated 2 years ago
- A Python package for easily implementing Concourse resource types.☆16Feb 20, 2026Updated 2 weeks ago
- Use NavamAI to supercharge your productivity and workflow with personal, fast, and quality AI. Turn your Terminal into a configurable, in…☆26Oct 15, 2024Updated last year
- Plugin for Obsidian.md — Thesaurus, dictionary and more using the Datamuse API☆54May 22, 2024Updated last year
- The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.☆68May 9, 2023Updated 2 years ago
- Containerized workflow automation tool☆22Feb 23, 2026Updated 2 weeks ago
- Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/☆10,096May 8, 2025Updated 10 months ago
- A modern shell☆353Nov 14, 2025Updated 3 months ago
- Benchmarking Mobile Device Control Agents across Diverse Configurations (ICLR 2024 workshop GenAI4DM spotlight presentation; CoLLAs 2025)☆35Jul 21, 2025Updated 7 months ago
- Python scraper based on AI☆22,845Feb 24, 2026Updated 2 weeks ago
- 🕰 Convert datetimes between timezones☆23Oct 17, 2025Updated 4 months ago
- A python implementation of delta debugging tool.☆26Feb 9, 2024Updated 2 years ago
- Easy to deploy.A cloud service for python code interpreter sandbox for Code-Interpreter.☆59Mar 12, 2024Updated last year
- Natural language browser automation☆628Dec 21, 2024Updated last year
- Read files (pdf/png/jpg) with OCR and rename using AI.☆25Nov 12, 2023Updated 2 years ago
- This is a Telegram Bot 🤖 using Flowise API call giving a lot of posibilities with langchain tecnology.☆22Jun 27, 2024Updated last year
- Convert HTML to Markdown☆2,096Nov 16, 2025Updated 3 months ago
- Drop in replacement for the OpenAI Assistants API☆208Aug 18, 2025Updated 6 months ago
- MCP GitHub Mapper is a MCP tool that will map any repository remotely and import the map directly into your code editor.☆24Jul 18, 2025Updated 7 months ago
- Search, modify, and parse messy HTML with ease.☆40Jan 17, 2026Updated last month
- Official implementation of Beyond the Heatmap: A Rigorous Evaluation of Component Impact in MCTS-Based TSP Solvers.☆11Mar 1, 2026Updated last week
- A Python tool that uses AI to generate well-structured technical and educational articles from any topic. Features transparent reasoning,…☆17Apr 19, 2025Updated 10 months ago
- Interactive coding assistant for data scientists and machine learning developers, empowered by large language models.☆99Oct 8, 2024Updated last year