Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
☆84,686Sep 25, 2026Updated last week
Alternatives and similar repositories for crawl4ai
Users that are interested in crawl4ai are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Agents that use the browser.☆117,054Updated this week
- Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥☆188,161Updated this week
- Python scraper based on AI☆31,509Sep 25, 2026Updated last week
- 🙌 OpenHands: AI-Driven Development☆89,876Updated this week
- Build, run, and manage agent platforms.☆42,530Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.☆66,527Updated this week
- Get your documents ready for gen AI☆68,330Updated this week
- Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self…☆157,770Updated this week
- Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ in…☆206,565Updated this week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆153,863Updated this week
- Python tool for converting files and office documents to Markdown.☆188,166Updated this week
- 🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: http…☆85,409Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆59,318Updated this week
- An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.☆31,559Sep 30, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A collection of MCP servers.☆95,783Sep 27, 2026Updated last week
- RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to creat…☆91,622Updated this week
- 100+ AI Agents, Agent Skills and RAG Apps - Free and Open Source.☆140,605Updated this week
- The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails…☆60,080Updated this week
- Vane is an AI-powered answering engine.☆36,990Sep 1, 2026Updated last month
- Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience☆66,684Updated this week
- Autonomous coding agent as an SDK, IDE extension, or CLI assistant.☆69,768Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.☆77,167Updated this week
- 🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire …☆82,962Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.☆25,525Updated this week
- Build Real-Time Knowledge Graphs for AI Agents☆31,407Updated this week
- Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.☆81,039Updated this week
- The agent that grows with you☆250,930Updated this week
- Automate browser based workflows with AI☆23,130Updated this week
- FULL Augment Code, Claude Code, Cluely, CodeBuddy, Comet, Cursor, Devin AI, Junie, Kiro, Leap.new, Lovable, Manus, NotionAI, Orchids.app,…☆144,003Aug 11, 2026Updated last month
- Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. …☆37,558Aug 2, 2026Updated 2 months ago
- Model Context Protocol Servers☆90,977Updated this week
- YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automatin…☆21,800Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Run frontier AI locally.☆47,729Updated this week
- Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆182,096Updated this week
- An open-source RAG-based tool for chatting with your documents.☆25,801Jul 14, 2026Updated 2 months ago
- An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, s…☆83,351Updated this week
- The open source coding agent.☆211,597Updated this week
- The AI that really does things. Any OS. Any Platform. The lobster way. 🦞☆391,231Updated this week
- No fortress, purely open ground. OpenManus is Coming.☆58,452Updated this week