unclecode / crawl4ai
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper
☆25,127Updated this week
Alternatives and similar repositories for crawl4ai:
Users that are interested in crawl4ai are comparing it to the libraries listed below
- 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.☆21,693Updated this week
- Automate browser-based workflows with LLMs and Computer Vision☆11,426Updated this week
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your p…☆22,748Updated this week
- Get your documents ready for gen AI☆18,239Updated this week
- Python scraper based on AI☆17,181Updated this week
- An open-source RAG-based tool for chatting with your documents.☆20,315Updated this week
- library & platform to build, distribute, monetize ai apps that have the full context (like rewind, granola, etc.), open source, 100% loca…☆11,575Updated this week
- Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚☆18,680Updated this week
- A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.☆9,387Updated this week
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆16,235Updated this week
- Make websites accessible for AI agents☆14,568Updated this week
- OCR, layout analysis, reading order, table recognition in 90+ languages☆15,474Updated this week
- Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/☆7,430Updated this week
- An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.☆20,208Updated this week
- 🤗 smolagents: a barebones library for agents. Agents write python code to call tools and orchestrate other agents.☆5,197Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆17,712Updated 3 months ago
- The Memory layer for your AI apps☆23,953Updated this week
- SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensiv…☆14,188Updated this week
- File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.☆4,966Updated this week
- Build multi-modal Agents with memory, knowledge, tools and reasoning. Chat with them using a beautiful Agent UI.☆17,869Updated this week
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI☆18,641Updated this week
- A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆6,810Updated this week
- LLM based autonomous agent that conducts local and web research on any topic and generates a comprehensive report with citations.☆15,736Updated this week
- PDF to Markdown with vision models☆8,298Updated last month
- Collection of awesome LLM apps with AI Agents and RAG using OpenAI, Anthropic, Gemini and opensource models.☆12,576Updated this week
- Scira (Formerly MiniPerplx) is a minimalistic AI-powered search engine that helps you find information on the internet. Powered by Vercel…☆3,891Updated this week
- A language model programming library.☆5,556Updated 3 weeks ago
- Model Context Protocol Servers☆6,938Updated this week
- Finetune Llama 3.3, Mistral, Phi-4, Qwen 2.5 & Gemma LLMs 2-5x faster with 70% less memory☆20,611Updated this week
- An AI Hedge Fund Team☆6,466Updated this week