unclecode / crawl4ai
ππ€ Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper
β30,884Updated this week
Alternatives and similar repositories for crawl4ai:
Users that are interested in crawl4ai are comparing it to the libraries listed below
- π₯ Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.β26,234Updated this week
- Run your own AI cluster at home with everyday devices π±π» π₯οΈββ23,729Updated this week
- LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.β18,698Updated this week
- Python scraper based on AIβ18,127Updated this week
- Make websites accessible for AI agentsβ29,761Updated this week
- AI app store powered by 24/7 desktop history. open source | 100% local | dev friendly | 24/7 screen, mic recordingβ12,194Updated this week
- An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.β21,892Updated 3 weeks ago
- Automate browser-based workflows with LLMs and Computer Visionβ12,176Updated this week
- Agno is a lightweight library for building multi-modal Agentsβ19,012Updated this week
- β© Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chatβ¦β23,469Updated this week
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagβ¦β17,621Updated this week
- Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory! π¦₯β30,529Updated this week
- πͺ Create rich visualizations with AIβ7,504Updated this week
- State-of-the-art Machine Learning for the web. Run π€ Transformers directly in your browser, with no need for a server!β12,983Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.β18,709Updated 4 months ago
- A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.β10,369Updated 3 weeks ago
- Collection of awesome LLM apps with AI Agents and RAG using OpenAI, Anthropic, Gemini and opensource models.β16,460Updated this week
- Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/β7,856Updated this week
- The Memory layer for AI Agentsβ24,688Updated this week
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AIβ19,965Updated this week
- OCR, layout analysis, reading order, table recognition in 90+ languagesβ16,260Updated this week
- Convert PDF to markdown + JSON quickly with high accuracyβ20,826Updated this week
- An open-source RAG-based tool for chatting with your documents.β21,203Updated this week
- Run AI Agent in your browser.β7,322Updated this week
- Get your documents ready for gen AIβ21,406Updated this week
- tiny vision language modelβ7,409Updated last week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)β76,168Updated this week
- π€ smolagents: a barebones library for agents. Agents write python code to call tools and orchestrate other agents.β11,162Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work tβ¦β26,764Updated this week
- Drag & drop UI to build your customized LLM flowβ35,226Updated last week