unclecode / crawl4ai
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN
☆39,794Updated this week
Alternatives and similar repositories for crawl4ai:
Users that are interested in crawl4ai are comparing it to the libraries listed below
- 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.☆35,829Updated this week
- An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.☆23,861Updated 2 months ago
- Get your documents ready for gen AI☆27,466Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆30,248Updated this week
- LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.☆21,020Updated this week
- An open-source RAG-based tool for chatting with your documents.☆21,997Updated this week
- Agno is a lightweight library for building Agents with memory, knowledge, tools and reasoning.☆25,351Updated this week
- Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. …☆28,672Updated last week
- Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚☆27,671Updated last month
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆20,983Updated this week
- Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/☆8,591Updated this week
- A simple screen parsing tool towards pure vision based GUI agent☆21,635Updated 3 weeks ago
- Python scraper based on AI☆19,179Updated this week
- RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.☆49,576Updated this week
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your p…☆40,217Updated this week
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI☆21,336Updated last week
- Fully local web research and report writing assistant☆7,024Updated 3 weeks ago
- A collection of MCP servers.☆38,506Updated this week
- A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/aut…☆43,377Updated this week
- The Memory layer for AI Agents☆27,605Updated this week
- ⏩ Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of models, rules, prompts, docs, and other…☆25,665Updated this week
- Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, m…☆92,934Updated this week
- Build resilient language agents as graphs.☆11,605Updated this week
- AI app store powered by 24/7 desktop history. open source | 100% local | dev friendly | 24/7 screen, mic recording☆13,374Updated this week
- 🪄 Create rich visualizations with AI☆11,288Updated this week
- 🔥 Open Source No Code Web Data Extraction Platform. Turn Websites To APIs & Spreadsheets With No-Code Robots In Minutes 🔥☆11,833Updated this week
- 🦉 OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation☆15,697Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆19,626Updated last month
- Convert PDF to markdown + JSON quickly with high accuracy☆24,187Updated last week
- OCR & Document Extraction using vision models☆10,962Updated last week