Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf
☆86,167Oct 22, 2026Updated this week
Alternatives and similar repositories for crawl4ai
Users that are interested in crawl4ai are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API.☆119,035Updated this week
- Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥☆194,891Updated this week
- 🙌 OpenHands: AI-Driven Development☆91,730Updated this week
- Python scraper based on AI☆32,176Oct 6, 2026Updated 2 weeks ago
- 🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discor…☆89,436Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.☆67,739Updated this week
- Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self…☆159,422Updated this week
- Get your documents ready for gen AI☆69,501Updated this week
- Build, run, and manage agent platforms.☆42,878Updated this week
- Python tool for converting files and office documents to Markdown.☆191,933Updated this week
- Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ in…☆208,489Updated this week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆156,636Updated this week
- 100+ AI Agents, Agent Skills and RAG Apps - Free and Open Source.☆142,921Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆60,074Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A collection of MCP servers.☆96,818Updated this week
- RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to creat…☆92,806Updated this week
- The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails…☆61,963Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆78,512Updated this week
- An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.☆31,689Sep 30, 2025Updated last year
- The agent that grows with you☆256,726Updated this week
- 🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire …☆83,464Updated this week
- Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience☆67,510Updated this week
- Vane is an AI-powered answering engine.☆37,694Sep 1, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Reverse engineer anything with agents, from app behavior down to native binaries.☆379,456Updated this week
- Autonomous coding agent as an SDK, IDE extension, or CLI assistant.☆70,812Updated this week
- Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. …☆37,806Aug 2, 2026Updated 2 months ago
- The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.☆25,799Updated this week
- Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.☆82,412Updated this week
- Build Real-Time Knowledge Graphs for AI Agents☆32,180Updated this week
- Build AI Agents, Visually☆55,523Aug 13, 2026Updated 2 months ago
- A programming framework for agentic AI☆61,546Oct 16, 2026Updated last week
- An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, s…☆84,373Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- An agentic skills framework & software development methodology that works.☆304,682Updated this week
- Turn any website into a structured API. Extract, automate, search and monitor the web.☆18,020Updated this week
- FULL Augment Code, Claude Code, Cluely, CodeBuddy, Comet, Cursor, Devin AI, Junie, Kiro, Leap.new, Lovable, Manus, NotionAI, Orchids.app,…☆144,221Oct 12, 2026Updated last week
- Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero…☆101,866Updated this week
- The open source coding agent.☆221,159Updated this week
- An open-source RAG-based tool for chatting with your documents.☆25,830Jul 14, 2026Updated 3 months ago
- Automate browser based workflows with AI☆23,263Updated this week