apify / crawleeLinks
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
☆20,858Updated this week
Alternatives and similar repositories for crawlee
Users that are interested in crawlee are comparing it to the libraries listed below
Sorting:
- Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.☆12,024Updated last week
- 🧩 The Browser Extension Framework☆12,680Updated this week
- Open-source developer platform to power your entire infra and turn scripts into webhooks, workflows and UIs. Fastest workflow engine (13x…☆15,327Updated this week
- 🎥 Make videos programmatically with React☆24,960Updated this week
- 🧙♀️ Move Fast and Break Nothing. End-to-end typesafe APIs made easy.☆39,155Updated this week
- Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ in…☆162,772Updated this week
- Next-generation ORM for Node.js & TypeScript | PostgreSQL, MySQL, MariaDB, SQL Server, SQLite, MongoDB and CockroachDB☆44,808Updated this week
- 🌌 A complete search engine and RAG pipeline in your browser, server or edge network with support for full-text, vector, and hybrid sear…☆10,013Updated this week
- 🔥 🔥 🔥 Open Source Airtable Alternative☆59,177Updated this week
- Amplication brings order to the chaos of large-scale software development by creating Golden Paths for developers - streamlined workflows…☆15,985Updated 2 weeks ago
- BullMQ - Message Queue and Batch processing for NodeJS and Python based on Redis☆8,067Updated last week
- Web framework built on Web Standards☆27,775Updated this week
- Lightpanda: the headless browser designed for AI and automation☆11,104Updated last week
- Relocate resource intensive third-party scripts off of the main thread and into a web worker. 🎉☆13,596Updated 3 months ago
- Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.☆80,164Updated last week
- Build system optimized for JavaScript and TypeScript, written in Rust☆29,277Updated this week
- A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.☆54,970Updated this week
- Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Dow…☆7,290Updated this week
- Simple, powerful and flexible site generation framework with everything you love from Next.js.☆13,445Updated this week
- A React Framework for building internal tools, admin panels, dashboards & B2B apps with unmatched flexibility.☆33,663Updated this week
- 🦔 PostHog is an all-in-one developer platform for building successful products. We offer product analytics, web analytics, session repla…☆30,459Updated this week
- Visual Development for React, Vue, Svelte, Qwik, and more☆8,519Updated this week
- Markdown for the component era☆19,105Updated this week
- The world’s fastest framework for building websites.☆85,439Updated this week
- Open Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch ⚡ 🔍 ✨ Fast, typo tolerant, in-memory fuz…☆24,801Updated last week
- Rich-text editor with AI, MCP, and shadcn/ui☆15,622Updated this week
- Presentation Slides for Developers☆43,233Updated last week
- 🚀 Strapi is the leading open-source headless CMS. It’s 100% JavaScript/TypeScript, fully customizable, and developer-first.☆70,684Updated this week
- Appwrite® - The developers' cloud☆53,950Updated this week
- Trigger.dev – build and deploy fully‑managed AI agents and workflows☆12,993Updated this week