Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
☆21,859Updated this week
Alternatives and similar repositories for crawlee
Users that are interested in crawlee are comparing it to the libraries listed below
Sorting:
- 🔥 🔥 🔥 A Free & Self-hostable Airtable Alternative☆62,189Updated this week
- Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.☆83,080Updated this week
- The open-source notification Inbox infrastructure. E-mail, SMS, Push and Slack Integrations.☆38,617Updated this week
- 🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data☆84,899Feb 22, 2026Updated last week
- The Postgres development platform. Supabase gives you a dedicated Postgres database to build your web, mobile, and AI applications.☆98,292Updated this week
- JavaScript API for Chrome and Firefox☆93,620Updated this week
- Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ in…☆176,657Updated this week
- Web framework built on Web Standards☆28,960Updated this week
- React Flow | Svelte Flow - Powerful open source libraries for building node-based UIs with React (https://reactflow.dev) or Svelte (https…☆35,347Feb 20, 2026Updated last week
- A React Framework for building internal tools, admin panels, dashboards & B2B apps with unmatched flexibility.☆34,128Updated this week
- 🚀 Strapi is the leading open-source headless CMS. It’s 100% JavaScript/TypeScript, fully customizable, and developer-first.☆71,432Updated this week
- ✨ The Next Gen Airtable Alternative: No-Code Postgres☆20,947Updated this week
- 🧩 The Browser Extension Framework☆12,869Updated this week
- Build smaller, faster, and more secure desktop and mobile applications with a web frontend.☆103,238Updated this week
- Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.☆12,599Updated this week
- A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.☆56,120Updated this week
- Open Source realtime backend in 1 file☆56,410Updated this week
- Trigger.dev – build and deploy fully‑managed AI agents and workflows☆13,813Feb 22, 2026Updated last week
- The flexible backend for all your projects 🐰 Turn your DB into a headless CMS, admin panels, or apps with a custom UI, instant APIs, aut…☆34,277Updated this week
- ToolJet is the open-source foundation of ToolJet AI - the AI-native platform for building internal tools, dashboard, business application…☆37,492Updated this week
- The modern link attribution platform. Loved by world-class marketing teams like Framer, Perplexity, Superhuman, Twilio, Buffer and more.☆23,116Updated this week
- Payload is the open-source, fullstack Next.js framework, giving you instant backend superpowers. Get a full TypeScript backend and admin …☆40,794Updated this week
- 🧙♀️ Move Fast and Break Nothing. End-to-end typesafe APIs made easy.☆39,613Updated this week
- Appwrite® - complete cloud infrastructure for your web, mobile and AI apps. Including Auth, Databases, Storage, Functions, Messaging, Hos…☆54,952Updated this week
- A set of beautifully-designed, accessible components and a code distribution platform. Works with your favorite frameworks. Open Source. …☆107,322Updated this week
- Platform to build admin panels, internal tools, and dashboards. Integrates with 25+ databases and any API.☆39,205Updated this week
- The headless rich text editor framework for web artisans.☆35,319Updated this week
- Build AI Agents the easy way. Supports PostgreSQL, MySQL, MariaDB, MSSQL, MongoDB, Rest API, Docker, K8s, and more 🚀 AI Workflow toolki…☆27,660Updated this week
- Next-generation ORM for Node.js & TypeScript | PostgreSQL, MySQL, MariaDB, SQL Server, SQLite, MongoDB and CockroachDB☆45,382Updated this week
- 🌌 A complete search engine and RAG pipeline in your browser, server or edge network with support for full-text, vector, and hybrid sear…☆10,172Feb 13, 2026Updated 2 weeks ago
- The world's most flexible commerce platform.☆32,147Updated this week
- The AI Browser Automation Framework☆21,261Updated this week
- very good whiteboard infinite canvas SDK☆45,338Updated this week
- An open-source, self-hostable PaaS alternative to Vercel, Heroku & Netlify that lets you easily deploy static sites, databases, full-stac…☆50,944Feb 18, 2026Updated last week
- The web framework for content-driven websites. ⭐️ Star to support our work!☆57,044Updated this week
- Build AI Agents, Visually☆49,310Updated this week
- Crawl a site to generate knowledge files to create your own custom GPT from a URL☆22,173Jul 7, 2025Updated 7 months ago
- 🦔 PostHog is an all-in-one developer platform for building successful products. We offer product analytics, web analytics, session repla…☆31,733Updated this week
- ✨ Innovative and open-source visualization application that transforms various data formats, such as JSON, YAML, XML and CSV into interac…☆43,387Feb 19, 2026Updated last week