Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
☆23,640Jun 2, 2026Updated this week
Alternatives and similar repositories for crawlee
Users that are interested in crawlee are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🔥 🔥 🔥 A Free & Self-hostable Airtable Alternative☆63,213Updated this week
- Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.☆90,250Updated this week
- JavaScript API for Chrome and Firefox☆94,395May 31, 2026Updated last week
- The API to search, scrape, and interact with the web at scale. 🔥☆127,078Jun 1, 2026Updated last week
- The open-source communication infrastructure for agents and products☆39,059Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- The Postgres development platform. Supabase gives you a dedicated Postgres database to build your web, mobile, and AI applications.☆103,720Updated this week
- 🧩 The Browser Extension Framework☆13,048Updated this week
- Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.☆13,273Updated this week
- Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Dow…☆9,127May 29, 2026Updated last week
- Web framework built on Web Standards☆30,703May 28, 2026Updated last week
- React Flow | Svelte Flow - Powerful open source libraries for building node-based UIs with React (https://reactflow.dev) or Svelte (https…☆36,902Updated this week
- ✨ The Next Gen Airtable Alternative: No-Code Postgres☆21,303Updated this week
- Trigger.dev – build and deploy fully‑managed AI agents and workflows☆15,161May 30, 2026Updated last week
- Build smaller, faster, and more secure desktop and mobile applications with a web frontend.☆107,414Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ in…☆191,284Updated this week
- A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.☆57,982Updated this week
- Open Source realtime backend in 1 file☆58,894Updated this week
- 🚀 Strapi is the leading open-source headless CMS. It’s 100% JavaScript/TypeScript, fully customizable, and developer-first.☆72,331Updated this week
- A React Framework for building internal tools, admin panels, dashboards & B2B apps with unmatched flexibility.☆34,820Updated this week
- 🧙♀️ Move Fast and Break Nothing. End-to-end typesafe APIs made easy.☆40,301Updated this week
- The SDK For Browser Agents☆22,972Updated this week
- 🌌 A complete search engine and RAG pipeline in your browser, server or edge network with support for full-text, vector, and hybrid sear…☆10,390Feb 13, 2026Updated 3 months ago
- The headless rich text editor framework for web artisans.☆37,101Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A set of beautifully-designed, accessible components and a code distribution platform. Works with your favorite frameworks. Open Source. …☆115,646Updated this week
- Crawl a site to generate knowledge files to create your own custom GPT from a URL☆22,240Jul 7, 2025Updated 11 months ago
- Platform to build admin panels, internal tools, and dashboards. Integrates with 25+ databases and any API.☆39,950Updated this week
- The flexible backend for all your projects 🐰 Turn your DB into a headless CMS, admin panels, or apps with a custom UI, instant APIs, aut…☆36,024May 29, 2026Updated last week
- The modern link attribution platform. Loved by world-class marketing teams like Framer, Perplexity, Superhuman, Twilio, Buffer and more.☆23,650Updated this week
- An open-source, self-hostable PaaS alternative to Vercel, Heroku & Netlify that lets you easily deploy static sites, databases, full-stac…☆56,598Updated this week
- very good whiteboard infinite canvas SDK☆47,545Jun 1, 2026Updated last week
- 🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN☆67,725Updated this week
- Payload is the open-source, fullstack Next.js framework, giving you instant backend superpowers. Get a full TypeScript backend and admin …☆42,791Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The world's most flexible commerce platform.☆34,121Updated this week
- Next-generation ORM for Node.js & TypeScript | PostgreSQL, MySQL, MariaDB, SQL Server, SQLite, MongoDB and CockroachDB☆46,043Jun 1, 2026Updated last week
- ToolJet is the open-source foundation of ToolJet AI - the enterprise app generation platform for building internal tools, dashboard, busi…☆37,988Updated this week
- Appwrite® - complete cloud infrastructure for your web, mobile and AI apps. Including Auth, Databases, Storage, Functions, Messaging, Hos…☆56,204Updated this week
- Build AI Agents, Visually☆53,245May 30, 2026Updated last week
- AI agents, automations and apps that run your operations. Model agnostic.☆27,984Updated this week
- The web framework for content-driven websites. ⭐️ Star to support our work!☆59,726May 31, 2026Updated last week