Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
☆22,661Apr 1, 2026Updated this week
Alternatives and similar repositories for crawlee
Users that are interested in crawlee are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🔥 🔥 🔥 A Free & Self-hostable Airtable Alternative☆62,606Updated this week
- Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.☆85,332Mar 31, 2026Updated last week
- JavaScript API for Chrome and Firefox☆94,016Updated this week
- 🔥 The Web Data API for AI - Power AI agents with clean web data☆104,217Updated this week
- The open-source notification infrastructure. In-app Inbox component, E-mail, SMS, Push and Slack Integrations.☆38,764Updated this week
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- The Postgres development platform. Supabase gives you a dedicated Postgres database to build your web, mobile, and AI applications.☆100,137Updated this week
- 🧩 The Browser Extension Framework☆12,955Updated this week
- Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.☆12,860Mar 31, 2026Updated last week
- Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Dow…☆8,724Updated this week
- Web framework built on Web Standards☆29,735Updated this week
- React Flow | Svelte Flow - Powerful open source libraries for building node-based UIs with React (https://reactflow.dev) or Svelte (https…☆35,901Mar 27, 2026Updated last week
- ✨ The Next Gen Airtable Alternative: No-Code Postgres☆21,073Updated this week
- Trigger.dev – build and deploy fully‑managed AI agents and workflows☆14,356Updated this week
- Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ in…☆182,079Updated this week
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Build smaller, faster, and more secure desktop and mobile applications with a web frontend.☆105,010Updated this week
- A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.☆56,929Updated this week
- Open Source realtime backend in 1 file☆57,286Mar 30, 2026Updated last week
- 🚀 Strapi is the leading open-source headless CMS. It’s 100% JavaScript/TypeScript, fully customizable, and developer-first.☆71,761Updated this week
- The AI Browser Automation Framework☆21,773Updated this week
- A React Framework for building internal tools, admin panels, dashboards & B2B apps with unmatched flexibility.☆34,386Mar 30, 2026Updated last week
- 🧙♀️ Move Fast and Break Nothing. End-to-end typesafe APIs made easy.☆39,847Mar 30, 2026Updated last week
- 🌌 A complete search engine and RAG pipeline in your browser, server or edge network with support for full-text, vector, and hybrid sear…☆10,270Feb 13, 2026Updated last month
- A set of beautifully-designed, accessible components and a code distribution platform. Works with your favorite frameworks. Open Source. …☆111,177Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The headless rich text editor framework for web artisans.☆35,975Updated this week
- Crawl a site to generate knowledge files to create your own custom GPT from a URL☆22,224Jul 7, 2025Updated 8 months ago
- Platform to build admin panels, internal tools, and dashboards. Integrates with 25+ databases and any API.☆39,532Updated this week
- The flexible backend for all your projects 🐰 Turn your DB into a headless CMS, admin panels, or apps with a custom UI, instant APIs, aut…☆34,638Updated this week
- 🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN☆62,936Mar 30, 2026Updated last week
- The modern link attribution platform. Loved by world-class marketing teams like Framer, Perplexity, Superhuman, Twilio, Buffer and more.☆23,298Updated this week
- An open-source, self-hostable PaaS alternative to Vercel, Heroku & Netlify that lets you easily deploy static sites, databases, full-stac…☆52,559Updated this week
- very good whiteboard infinite canvas SDK☆46,210Updated this week
- Payload is the open-source, fullstack Next.js framework, giving you instant backend superpowers. Get a full TypeScript backend and admin …☆41,532Mar 31, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- The world's most flexible commerce platform.☆32,473Mar 30, 2026Updated last week
- Next-generation ORM for Node.js & TypeScript | PostgreSQL, MySQL, MariaDB, SQL Server, SQLite, MongoDB and CockroachDB☆45,660Updated this week
- ToolJet is the open-source foundation of ToolJet AI - the AI-native platform for building internal tools, dashboard, business application…☆37,707Updated this week
- Appwrite® - complete cloud infrastructure for your web, mobile and AI apps. Including Auth, Databases, Storage, Functions, Messaging, Hos…☆55,392Mar 30, 2026Updated last week
- Build AI Agents, Visually☆51,549Updated this week
- AI agents that run your operations. Model agnostic.☆27,781Mar 31, 2026Updated last week
- The web framework for content-driven websites. ⭐️ Star to support our work!☆58,146Updated this week