unclecode / crawl4ai
ππ€ Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper
β27,007Updated this week
Alternatives and similar repositories for crawl4ai:
Users that are interested in crawl4ai are comparing it to the libraries listed below
- π₯ Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.β22,528Updated this week
- An open-source RAG-based tool for chatting with your documents.β20,562Updated this week
- Python scraper based on AIβ17,390Updated this week
- An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.β20,843Updated this week
- library & platform to build, distribute, monetize ai apps that have the full context (like rewind, granola, etc.), open source, 100% locaβ¦β11,827Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.β18,175Updated 3 months ago
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your pβ¦β24,093Updated this week
- Build multi-modal Agents with memory, knowledge, tools and reasoning. Chat with them using a beautiful Agent UI.β18,184Updated this week
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AIβ19,052Updated 2 weeks ago
- Open source Claude Artifacts β built with Llama 3.1 405Bβ5,316Updated this week
- Run your own AI cluster at home with everyday devices π±π» π₯οΈββ19,676Updated this week
- Automate browser-based workflows with LLMs and Computer Visionβ11,737Updated this week
- Make websites accessible for AI agentsβ17,141Updated this week
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagβ¦β16,565Updated this week
- Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. β¦β25,186Updated this week
- Agent Framework / shim to use Pydantic with LLMsβ5,741Updated this week
- Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/β7,499Updated this week
- Scira (Formerly MiniPerplx) is a minimalistic AI-powered search engine that helps you find information on the internet. Powered by Vercelβ¦β4,271Updated this week
- A modular graph-based Retrieval-Augmented Generation (RAG) systemβ21,854Updated this week
- Convert PDF to markdown + JSON quickly with high accuracyβ19,517Updated this week
- File Parser optimised for LLM Ingestion with no loss π§ Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.β5,172Updated last week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work tβ¦β25,314Updated this week
- Get your documents ready for gen AIβ18,998Updated this week
- A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.β9,670Updated last week
- π€ Open-source GenBI AI Agent that empowers data-driven teams to chat with their data to generate Text-to-SQL, charts, spreadsheets, repoβ¦β5,157Updated this week
- Model Context Protocol Serversβ7,244Updated this week
- Retrieval Augmented Generation (RAG) chatbot powered by Weaviateβ6,669Updated last week
- The Memory layer for your AI appsβ24,104Updated this week
- π₯ Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes [In Beta]β8,621Updated this week
- π€ smolagents: a barebones library for agents. Agents write python code to call tools and orchestrate other agents.β5,770Updated this week