apify / crawlee-pythonLinks
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
☆5,740Updated this week
Alternatives and similar repositories for crawlee-python
Users that are interested in crawlee-python are comparing it to the libraries listed below
Sorting:
- Automate browser-based workflows with LLMs and Computer Vision☆13,584Updated last week
- Rapidly build AI apps in Python☆6,312Updated 2 weeks ago
- A visual playground for agentic workflows: Iterate over your agents 10x faster☆5,153Updated last month
- Turn any webpage into structured data using LLMs☆4,957Updated last month
- Agent Framework / shim to use Pydantic with LLMs☆10,271Updated this week
- Full-stack framework for building Multi-Agent Systems with memory, knowledge and reasoning.☆28,467Updated this week
- Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/☆8,862Updated last month
- 🔥 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser instance that lets you automate the web wi…☆4,653Updated this week
- The AI Browser Automation Framework☆12,407Updated this week
- Python scraper based on AI☆20,007Updated this week
- The fastest way to create an HTML app☆6,426Updated last week
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI☆22,357Updated 3 weeks ago
- The easiest way to deploy agents, MCP servers, models, RAG, pipelines and more. No MLOps. No YAML.☆3,298Updated this week
- Scira (Formerly MiniPerplx) is a minimalistic AI-powered search engine that helps you find information on the internet and cites it too. …☆8,315Updated this week
- Large Action Model framework to develop AI Web Agents☆6,075Updated 5 months ago
- Agent S: an open agentic framework that uses computers like a human☆5,486Updated this week
- Open source AI coding agent. Designed for large projects and real world tasks.☆13,802Updated this week
- Lightweight library for scraping web-sites with LLMs☆1,108Updated 2 weeks ago
- A system for agentic LLM-powered data processing and ETL☆2,223Updated this week
- Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web, vision.☆3,869Updated this week
- No-code LLM Platform to launch APIs and ETL Pipelines to structure unstructured documents☆5,366Updated this week
- Open-source Next.js template for building apps that are fully generated by AI. By E2B.☆5,525Updated this week
- A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with gi…☆13,864Updated this week
- Retrieval Augmented Generation (RAG) chatbot powered by Weaviate☆7,169Updated 2 months ago
- Open-Source Chrome extension for AI-powered web automation. Run multi-agent workflows using your own LLM API key. Alternative to OpenAI O…☆6,835Updated this week
- PraisonAI is a production-ready Multi AI Agents framework, designed to create AI Agents to automate and solve problems ranging from simpl…☆4,882Updated this week
- Lightpanda: the headless browser designed for AI and automation☆9,175Updated this week
- c/ua is the Docker Container for Computer-Use AI Agents.☆8,622Updated this week
- An open-source RAG-based tool for chatting with your documents.☆22,483Updated last week
- Devon: An open-source pair programmer☆3,429Updated 3 weeks ago