Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
☆26,234Oct 23, 2026Updated this week
Alternatives and similar repositories for crawlee
Users that are interested in crawlee are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI …☆86,104Updated this week
- Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.☆98,361Updated this week
- Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Dow…☆9,616Updated this week
- 🔥 🔥 🔥 A Free & Self-hostable Airtable Alternative☆65,332Updated this week
- The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.☆25,791Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- JavaScript API for Chrome and Firefox☆95,743Updated this week
- Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥☆194,359Updated this week
- Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.☆13,845Updated this week
- Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API.☆118,959Updated this week
- The open-source communication infrastructure for agents and products☆40,191Updated this week
- React Flow | Svelte Flow - Powerful open source libraries for building node-based UIs with React (https://reactflow.dev) or Svelte (https…☆38,759Updated this week
- The Postgres development platform. Supabase gives you a dedicated Postgres database to build your web, mobile, and AI applications.☆113,786Updated this week
- Web framework built on Web Standards☆32,640Updated this week
- ✨ AI Spreadsheet for Business☆21,917Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Trigger.dev – build and deploy durable AI agents and workflows☆16,608Updated this week
- A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.☆59,642Updated this week
- Build smaller, faster, and more secure desktop and mobile applications with a web frontend.☆112,142Updated this week
- A React Framework for building internal tools, admin panels, dashboards & B2B apps with unmatched flexibility.☆35,930Sep 10, 2026Updated last month
- 🚀 Strapi is the leading open-source headless CMS. It’s 100% JavaScript/TypeScript, fully customizable, and developer-first.☆73,361Updated this week
- Payload is the open-source, fullstack Next.js framework, giving you instant backend superpowers. Get a full TypeScript backend and admin …☆45,446Updated this week
- Open Source realtime backend in 1 file☆61,561Updated this week
- The world's most flexible commerce platform for agents and developers☆36,870Updated this week
- Platform to build admin panels, internal tools, and dashboards. Integrates with 25+ databases and any API.☆41,111Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Umami is a privacy-first web and product analytics platform. Traffic, campaigns, behavior, conversions, and revenue in one place. No cook…☆39,589Updated this week
- Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ in…☆208,393Updated this week
- An open-source, self-hostable PaaS alternative to Vercel, Heroku & Netlify that lets you easily deploy static sites, databases, full-stac…☆63,543Updated this week
- The flexible backend for all your projects 🐰 Turn your DB into a headless CMS, admin panels, or apps with a custom UI, instant APIs, aut…☆38,624Updated this week
- Lightpanda: the headless browser designed for AI and automation☆36,912Updated this week
- Open-source foundation of ToolJet AI - the enterprise app generation platform for internal tools, dashboards, business applications, work…☆41,120Updated this week
- The headless rich text editor framework for web artisans.☆38,817Updated this week
- Build infinite canvas apps in React with the tldraw SDK. World's best, top-most agent recommended #1 five star SDK.☆51,057Updated this week
- 🧩 The Browser Extension Framework☆13,168Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- PostHog is the leading platform for building self-driving products. Our developer tools – AI observability, analytics, session replay, f…☆40,390Updated this week
- There can be more than Notion and Miro. AFFiNE(pronounced [ə‘fain]) is a next-gen knowledge base that brings planning, sorting and creati…☆73,775Updated this week
- The open-source cloud for agents & devs. Including Auth, Databases, Storage, Functions, Messaging, Hosting, Realtime, WAF and more☆57,758Updated this week
- 🔥🔥🔥 Open-source Jira, Linear, Monday, and ClickUp alternative. Plane is a modern project management platform to manage tasks, sprints,…☆61,334Updated this week
- Composable, accessible components with thoughtful defaults. Build your own component library with code you can customize, extend, and mak…☆126,322Updated this week
- 🧙♀️ Move Fast and Break Nothing. End-to-end typesafe APIs made easy.☆40,719Updated this week
- Python scraper based on AI☆32,156Oct 6, 2026Updated 2 weeks ago