unclecode / crawl4ai
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN
☆42,518Updated this week
Alternatives and similar repositories for crawl4ai:
Users that are interested in crawl4ai are comparing it to the libraries listed below
- 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.☆37,936Updated this week
- Agno is a lightweight library for building Agents with memory, knowledge, tools and reasoning.☆26,465Updated this week
- AI app store powered by 24/7 desktop history. open source | 100% local | dev friendly | 24/7 screen, mic recording☆14,388Updated last week
- Run AI Agent in your browser.☆12,794Updated this week
- An open-source RAG-based tool for chatting with your documents.☆22,205Updated 3 weeks ago
- Get your documents ready for gen AI☆28,950Updated this week
- Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚☆27,984Updated last month
- A simple screen parsing tool towards pure vision based GUI agent☆21,960Updated last month
- 🌐 Make websites accessible for AI agents. Automate tasks online with ease.☆59,385Updated this week
- Python scraper based on AI☆19,490Updated this week
- Python tool for converting files and office documents to Markdown.☆56,577Updated 3 weeks ago
- Convert PDF to markdown + JSON quickly with high accuracy☆24,799Updated last week
- A high-quality tool for convert PDF to Markdown and JSON.一站式开源高质量数据提取工具，将PDF转换成Markdown和JSON格式。☆32,914Updated this week
- An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.☆24,258Updated last week
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your p…☆43,286Updated this week
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆25,078Updated this week
- Simple, unified interface to multiple Generative AI providers☆12,047Updated this week
- Toolkit for linearizing PDFs for LLM datasets/training☆12,311Updated this week
- Memory for AI Agents; SOTA in AI Agent Memory, beating OpenAI Memory in accuracy by 26% - https://mem0.ai/research☆28,809Updated this week
- Scira (Formerly MiniPerplx) is a minimalistic AI-powered search engine that helps you find information on the internet and cites it too. …☆7,827Updated this week
- Fully local web research and report writing assistant☆7,308Updated last month
- ⏩ Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of models, rules, prompts, docs, and other…☆26,110Updated this week
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆22,215Updated this week
- Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.☆139,991Updated this week
- A GUI Agent application based on UI-TARS(Vision-Language Model) that allows you to control your computer using natural language.☆13,298Updated this week
- Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/☆8,684Updated this week
- LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.☆21,308Updated this week
- The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.☆43,905Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆19,740Updated 2 months ago
- 🪄 Create rich visualizations with AI☆11,471Updated last week