apify / crawleeLinks
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
☆18,030Updated this week
Alternatives and similar repositories for crawlee
Users that are interested in crawlee are comparing it to the libraries listed below
Sorting:
- Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.☆10,334Updated this week
- React Flow | Svelte Flow - Powerful open source libraries for building node-based UIs with React (https://reactflow.dev) or Svelte (https…☆30,293Updated this week
- 🌌 A complete search engine and RAG pipeline in your browser, server or edge network with support for full-text, vector, and hybrid sear…☆9,510Updated this week
- Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Dow…☆5,771Updated this week
- Open Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch ⚡ 🔍 ✨ Fast, typo tolerant, in-memory fuz…☆23,616Updated this week
- Build system optimized for JavaScript and TypeScript, written in Rust☆28,023Updated this week
- ✨ Innovative and open-source visualization application that transforms various data formats, such as JSON, YAML, XML, CSV and more, into …☆38,622Updated last week
- 🧩 The Browser Extension Framework☆11,967Updated this week
- ✨ The Next Gen Airtable Alternative: No-Code Postgres☆18,820Updated this week
- Open Source realtime backend in 1 file☆47,986Updated this week
- Optimizing compiler for React☆17,239Updated 11 months ago
- Lightpanda: the headless browser designed for AI and automation☆9,246Updated this week
- The Postgres development platform. Supabase gives you a dedicated Postgres database to build your web, mobile, and AI applications.☆85,015Updated this week
- AI Agents & MCPs & AI Workflow Automation • (280+ MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Age…☆15,557Updated this week
- 🔥 🔥 🔥 Open Source Airtable Alternative☆55,389Updated this week
- 💯 Teach puppeteer new tricks through plugins.☆6,892Updated 11 months ago
- Write components once, run everywhere. Compiles to React, Vue, Qwik, Solid, Angular, Svelte, and more.☆13,254Updated this week
- A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.☆52,066Updated this week
- Web framework built on Web Standards☆24,893Updated this week
- 🧙♀️ Move Fast and Break Nothing. End-to-end typesafe APIs made easy.☆37,675Updated this week
- 🌳 Tiny & elegant JavaScript HTTP client based on the Fetch API☆15,007Updated 2 weeks ago
- Trigger.dev – open source background jobs and AI infrastructure☆11,571Updated this week
- Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.☆74,128Updated this week
- The web framework for content-driven websites. ⭐️ Star to support our work!☆51,872Updated this week
- Visual Development for React, Vue, Svelte, Qwik, and more☆8,247Updated this week
- The open source Zapier alternative. Build workflow automation without spending time and money.☆11,964Updated this week
- Instant-loading web apps, without effort☆21,456Updated this week
- React components to build charts and dashboards☆16,378Updated 5 months ago
- Open Source Alternative to Vercel, Netlify and Heroku.☆21,083Updated this week
- Rust-based platform for the Web☆32,391Updated this week