apify / crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
☆16,762Updated this week
Alternatives and similar repositories for crawlee:
Users that are interested in crawlee are comparing it to the libraries listed below
- Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.☆9,341Updated this week
- Enlightened library to convert HTML and CSS to SVG☆11,446Updated last month
- 🧩 The Browser Extension Framework☆11,079Updated this week
- React Flow | Svelte Flow - Powerful open source libraries for building node-based UIs with React (https://reactflow.dev) or Svelte (https…☆27,508Updated last week
- Build system optimized for JavaScript and TypeScript, written in Rust☆26,960Updated this week
- React components to build charts and dashboards☆16,324Updated last month
- Create business apps and automate workflows in minutes. Supports PostgreSQL, MySQL, MariaDB, MSSQL, MongoDB, Rest API, Docker, K8s, and m…☆23,408Updated this week
- 🦔 PostHog provides open-source web & product analytics, session recording, feature flagging and A/B testing that you can self-host. Get …☆24,148Updated this week
- An open-source & self-hostable Heroku / Netlify / Vercel alternative.☆37,214Updated this week
- Open-source developer platform to power your entire infra and turn scripts into webhooks, workflows and UIs. Fastest workflow engine (13x…☆11,938Updated this week
- Write components once, run everywhere. Compiles to React, Vue, Qwik, Solid, Angular, Svelte, and more.☆12,807Updated this week
- 🌌 A complete search engine and RAG pipeline in your browser, server or edge network with support for full-text, vector, and hybrid sear…☆9,040Updated this week
- Relocate resource intensive third-party scripts off of the main thread and into a web worker. 🎉☆13,205Updated last month
- The world's most flexible commerce platform.☆27,569Updated this week
- Optimize React performance and make your React 70% faster in minutes, not months.☆16,896Updated 6 months ago
- Open Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch ⚡ 🔍 ✨ Fast, typo tolerant, in-memory fuz…☆22,049Updated this week
- Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.☆69,218Updated this week
- Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Dow…☆5,258Updated this week
- 🚀🎉📚 APITable, an API-oriented low-code platform for building collaborative apps and better than all other Airtable open-source alterna…☆13,773Updated last month
- Fast, unstyled command menu React component.☆10,421Updated 3 months ago
- Simple, open source, lightweight (< 1 KB) and privacy-friendly web analytics alternative to Google Analytics.☆21,419Updated this week
- Instant-loading web apps, without effort☆21,105Updated this week
- High performance, self-hosted, newsletter and mailing list manager with a modern dashboard. Single binary app.☆16,022Updated this week
- Low-code platform for building business applications. Connect to databases, cloud storages, GraphQL, API endpoints, Airtable, Google shee…☆34,636Updated this week
- 🔥 🔥 🔥 Open Source JIRA, Linear, Monday, and Asana Alternative. Plane helps you track your issues, epics, and cycles the easiest way on…☆32,254Updated this week
- 🧙♀️ Move Fast and Break Nothing. End-to-end typesafe APIs made easy.☆35,904Updated this week
- Umami is a simple, fast, privacy-focused alternative to Google Analytics.☆24,251Updated this week
- Next-Generation full text search library for Browser and Node.js☆12,684Updated this week
- Open-source link attribution platform. Loved by modern marketing teams like Twilio, Perplexity, Vercel, and Huberman Labs.☆19,896Updated this week
- Notion-style WYSIWYG editor with AI-powered autocompletion.☆13,816Updated 3 weeks ago