Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.
☆9,679Nov 20, 2026Updated this week
Alternatives and similar repositories for crawlee-python
Users that are interested in crawlee-python are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data …☆26,511Updated this week
- Python scraper based on AI☆32,878Oct 6, 2026Updated last month
- Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. F…☆87,633Updated this week
- An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.☆31,922Sep 30, 2025Updated last year
- The self-managing agent platform☆43,254Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Automate browser based workflows with AI☆23,484Updated this week
- Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API.☆121,660Updated this week
- 🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https:/…☆104,787Updated this week
- The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.☆26,109Updated this week
- Vane is an AI-powered answering engine.☆38,275Sep 1, 2026Updated 2 months ago
- The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.☆69,307Updated this week
- Knowledge infrastructure to make your agents smarter. Search, scrape and access 550+ data providers through one API.☆206,196Updated this week
- Get your documents ready for gen AI☆70,846Updated this week
- OCR, layout analysis, reading order, table recognition in 90+ languages☆21,608Nov 13, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An open-source RAG-based tool for chatting with your documents.☆25,924Jul 14, 2026Updated 4 months ago
- Turn any website into a structured API. Extract, automate, search and monitor the web.☆18,540Updated this week
- 🙌 OpenHands: AI-Driven Development☆93,953Updated this week
- A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive vi…☆39,348Nov 10, 2026Updated last week
- Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. …☆38,196Aug 2, 2026Updated 3 months ago
- Lightpanda: the headless browser designed for AI and automation☆42,298Updated this week
- File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.☆7,416Oct 15, 2026Updated last month
- Convert PDF to markdown + JSON quickly with high accuracy☆41,010Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆61,143Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 🕸️ Web apps in pure Python 🐍☆29,042Updated this week
- An autonomous agent that conducts deep research on any data using any LLM providers☆30,813Nov 12, 2026Updated last week
- Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience☆68,480Updated this week
- 🪄 Data Formulator is an interactive AI-powered data analysis system makes it easy to connect, explore and visualize data.☆17,692Updated this week
- Turn any webpage into structured data using LLMs☆6,956Oct 26, 2026Updated 3 weeks ago
- We write your reusable computer vision tools. 💜☆51,688Updated this week
- SOTA Open Source TTS☆33,820Nov 14, 2026Updated last week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆79,895Updated this week
- The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails…☆63,659Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Private AI agents for highly regulated teams, and for anyone who wants AI on their own computer. Open-source Python agent framework that …☆9,377Updated this week
- Turns Data and AI algorithms into production-ready web applications in no time.☆19,459Aug 10, 2026Updated 3 months ago
- Sim is the collaborative workspace to build, deploy, and monitor AI agents and workflows. Used by 100,000+ builders.☆30,170Updated this week
- The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Protocol☆38,859Updated this week
- Self-hosted AI coding assistant☆33,931Jun 30, 2026Updated 4 months ago
- Build Real-Time Knowledge Graphs for AI Agents☆32,976Updated this week
- Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.☆7,145Nov 8, 2026Updated last week
Are these results useful?