Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
☆25,977Oct 2, 2026Updated this week
Alternatives and similar repositories for crawlee
Users that are interested in crawlee are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.☆97,045Updated this week
- 🔥 🔥 🔥 A Free & Self-hostable Airtable Alternative☆65,168Updated this week
- JavaScript API for Chrome and Firefox☆95,647Updated this week
- Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Dow…☆9,575Updated this week
- The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.☆25,525Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The open-source communication infrastructure for agents and products☆40,106Updated this week
- A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.☆59,475Updated this week
- Trigger.dev – build and deploy durable AI agents and workflows☆16,458Updated this week
- The Postgres development platform. Supabase gives you a dedicated Postgres database to build your web, mobile, and AI applications.☆111,044Updated this week
- Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.☆13,766Updated this week
- 🧩 The Browser Extension Framework☆13,162Updated this week
- Web framework built on Web Standards☆32,403Updated this week
- Open Source realtime backend in 1 file☆61,257Updated this week
- React Flow | Svelte Flow - Powerful open source libraries for building node-based UIs with React (https://reactflow.dev) or Svelte (https…☆38,578Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Build smaller, faster, and more secure desktop and mobile applications with a web frontend.☆111,567Updated this week
- ✨ AI Spreadsheet for Business☆21,855Updated this week
- 🚀 Strapi is the leading open-source headless CMS. It’s 100% JavaScript/TypeScript, fully customizable, and developer-first.☆73,275Updated this week
- A React Framework for building internal tools, admin panels, dashboards & B2B apps with unmatched flexibility.☆35,756Sep 10, 2026Updated 3 weeks ago
- 🧙♀️ Move Fast and Break Nothing. End-to-end typesafe APIs made easy.☆40,685Updated this week
- Build infinite canvas apps in React with the tldraw SDK. World's best, top-most agent recommended #1 five star SDK.☆50,727Updated this week
- 🌌 A complete search engine and RAG pipeline in your browser, server or edge network with support for full-text, vector, and hybrid sear…☆10,569Updated this week
- Next-generation ORM for Node.js & TypeScript | PostgreSQL, MySQL, MariaDB, SQL Server, SQLite, MongoDB and CockroachDB☆47,689Updated this week
- The headless rich text editor framework for web artisans.☆38,629Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Composable, accessible components with thoughtful defaults. Build your own component library with code you can customize, extend, and mak…☆125,044Updated this week
- Crawl a site to generate knowledge files to create your own custom GPT from a URL☆22,405Jul 7, 2025Updated last year
- Platform to build admin panels, internal tools, and dashboards. Integrates with 25+ databases and any API.☆40,995Updated this week
- The modern link attribution platform. Loved by world-class marketing teams like Framer, Perplexity, Superhuman, Twilio, Buffer and more.☆24,861Updated this week
- Payload is the open-source, fullstack Next.js framework, giving you instant backend superpowers. Get a full TypeScript backend and admin …☆45,069Updated this week
- The flexible backend for all your projects 🐰 Turn your DB into a headless CMS, admin panels, or apps with a custom UI, instant APIs, aut…☆38,011Updated this week
- Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI …☆84,686Sep 25, 2026Updated last week
- The world's most flexible commerce platform for agents and developers☆36,570Updated this week
- Appwrite® - complete cloud infrastructure for your web, mobile and AI apps. Including Auth, Databases, Storage, Functions, Messaging, Hos…☆57,555Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- An open-source, self-hostable PaaS alternative to Vercel, Heroku & Netlify that lets you easily deploy static sites, databases, full-stac…☆62,545Updated this week
- Open-source foundation of ToolJet AI - the enterprise app generation platform for internal tools, dashboards, business applications, work…☆41,028Updated this week
- Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ in…☆206,565Updated this week
- The web framework for content-driven websites. ⭐️ Star to support our work!☆63,026Updated this week
- PostHog is the leading platform for building self-driving products. Our developer tools – AI observability, analytics, session replay, f…☆40,119Updated this week
- Build AI Agents, Visually☆55,485Aug 13, 2026Updated last month
- AI agents, automations and apps that run your operations. Model agnostic.☆28,333Updated this week