Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
☆22,886Apr 20, 2026Updated last week
Alternatives and similar repositories for crawlee
Users that are interested in crawlee are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🔥 🔥 🔥 A Free & Self-hostable Airtable Alternative☆62,848Updated this week
- Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.☆86,939Updated this week
- JavaScript API for Chrome and Firefox☆94,191Updated this week
- 🔥 The API to search, scrape, and interact with the web for AI☆112,116Updated this week
- The open-source notification infrastructure. In-app Inbox component, E-mail, SMS, Push and Slack Integrations.☆38,866Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- The Postgres development platform. Supabase gives you a dedicated Postgres database to build your web, mobile, and AI applications.☆101,347Updated this week
- 🧩 The Browser Extension Framework☆12,991Updated this week
- Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.☆12,994Updated this week
- Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Dow…☆8,816Updated this week
- Web framework built on Web Standards☆30,136Updated this week
- React Flow | Svelte Flow - Powerful open source libraries for building node-based UIs with React (https://reactflow.dev) or Svelte (https…☆36,232Apr 10, 2026Updated 2 weeks ago
- ✨ The Next Gen Airtable Alternative: No-Code Postgres☆21,154Updated this week
- Trigger.dev – build and deploy fully‑managed AI agents and workflows☆14,668Updated this week
- Build smaller, faster, and more secure desktop and mobile applications with a web frontend.☆105,666Apr 20, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ in…☆185,208Updated this week
- A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.☆57,291Updated this week
- Open Source realtime backend in 1 file☆57,820Updated this week
- 🚀 Strapi is the leading open-source headless CMS. It’s 100% JavaScript/TypeScript, fully customizable, and developer-first.☆71,991Updated this week
- The SDK For Browser Agents☆22,274Updated this week
- 🧙♀️ Move Fast and Break Nothing. End-to-end typesafe APIs made easy.☆40,044Apr 20, 2026Updated last week
- A React Framework for building internal tools, admin panels, dashboards & B2B apps with unmatched flexibility.☆34,522Apr 15, 2026Updated last week
- 🌌 A complete search engine and RAG pipeline in your browser, server or edge network with support for full-text, vector, and hybrid sear…☆10,299Feb 13, 2026Updated 2 months ago
- The headless rich text editor framework for web artisans.☆36,355Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A set of beautifully-designed, accessible components and a code distribution platform. Works with your favorite frameworks. Open Source. …☆112,770Updated this week
- Crawl a site to generate knowledge files to create your own custom GPT from a URL☆22,239Jul 7, 2025Updated 9 months ago
- The flexible backend for all your projects 🐰 Turn your DB into a headless CMS, admin panels, or apps with a custom UI, instant APIs, aut…☆34,906Updated this week
- Platform to build admin panels, internal tools, and dashboards. Integrates with 25+ databases and any API.☆39,688Updated this week
- 🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN☆64,362Apr 20, 2026Updated last week
- The modern link attribution platform. Loved by world-class marketing teams like Framer, Perplexity, Superhuman, Twilio, Buffer and more.☆23,438Updated this week
- An open-source, self-hostable PaaS alternative to Vercel, Heroku & Netlify that lets you easily deploy static sites, databases, full-stac…☆54,167Updated this week
- very good whiteboard infinite canvas SDK☆46,505Updated this week
- Payload is the open-source, fullstack Next.js framework, giving you instant backend superpowers. Get a full TypeScript backend and admin …☆41,932Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- The world's most flexible commerce platform.☆32,726Apr 20, 2026Updated last week
- Next-generation ORM for Node.js & TypeScript | PostgreSQL, MySQL, MariaDB, SQL Server, SQLite, MongoDB and CockroachDB☆45,840Updated this week
- ToolJet is the open-source foundation of ToolJet AI - the enterprise app generation platform for building internal tools, dashboard, busi…☆37,788Updated this week
- Appwrite® - complete cloud infrastructure for your web, mobile and AI apps. Including Auth, Databases, Storage, Functions, Messaging, Hos…☆55,792Updated this week
- Build AI Agents, Visually☆52,280Updated this week
- AI agents, automations and apps that run your operations. Model agnostic.☆27,838Updated this week
- The web framework for content-driven websites. ⭐️ Star to support our work!☆58,748Updated this week