unclecode / crawl4ai
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper
☆27,007Updated this week
Alternatives and similar repositories for crawl4ai:
Users that are interested in crawl4ai are comparing it to the libraries listed below
- 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.☆22,528Updated this week
- An open-source RAG-based tool for chatting with your documents.☆20,562Updated this week
- Python scraper based on AI☆17,390Updated this week
- An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.☆20,843Updated this week
- library & platform to build, distribute, monetize ai apps that have the full context (like rewind, granola, etc.), open source, 100% loca…☆11,827Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆18,175Updated 3 months ago
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your p…☆24,093Updated this week
- Build multi-modal Agents with memory, knowledge, tools and reasoning. Chat with them using a beautiful Agent UI.☆18,184Updated this week
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI☆19,052Updated 2 weeks ago
- Open source Claude Artifacts – built with Llama 3.1 405B☆5,316Updated this week
- Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚☆19,676Updated this week
- Automate browser-based workflows with LLMs and Computer Vision☆11,737Updated this week
- Make websites accessible for AI agents☆17,141Updated this week
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆16,565Updated this week
- Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. …☆25,186Updated this week
- Agent Framework / shim to use Pydantic with LLMs☆5,741Updated this week
- Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/☆7,499Updated this week
- Scira (Formerly MiniPerplx) is a minimalistic AI-powered search engine that helps you find information on the internet. Powered by Vercel…☆4,271Updated this week
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆21,854Updated this week
- Convert PDF to markdown + JSON quickly with high accuracy☆19,517Updated this week
- File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.☆5,172Updated last week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆25,314Updated this week
- Get your documents ready for gen AI☆18,998Updated this week
- A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.☆9,670Updated last week
- 🤖 Open-source GenBI AI Agent that empowers data-driven teams to chat with their data to generate Text-to-SQL, charts, spreadsheets, repo…☆5,157Updated this week
- Model Context Protocol Servers☆7,244Updated this week
- Retrieval Augmented Generation (RAG) chatbot powered by Weaviate☆6,669Updated last week
- The Memory layer for your AI apps☆24,104Updated this week
- 🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes [In Beta]☆8,621Updated this week
- 🤗 smolagents: a barebones library for agents. Agents write python code to call tools and orchestrate other agents.☆5,770Updated this week