apify / crawleeLinks
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
☆18,133Updated this week
Alternatives and similar repositories for crawlee
Users that are interested in crawlee are comparing it to the libraries listed below
Sorting:
- Open-source developer platform to power your entire infra and turn scripts into webhooks, workflows and UIs. Fastest workflow engine (13x…☆14,027Updated this week
- Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.☆10,403Updated this week
- Trigger.dev – open source background jobs and AI infrastructure☆11,680Updated this week
- Infisical is the open-source platform for secrets management, PKI, and SSH access.☆18,793Updated this week
- ✨ Innovative and open-source visualization application that transforms various data formats, such as JSON, YAML, XML, CSV and more, into …☆39,357Updated last week
- Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Dow…☆5,814Updated this week
- 🌌 A complete search engine and RAG pipeline in your browser, server or edge network with support for full-text, vector, and hybrid sear…☆9,535Updated last week
- The headless rich text editor framework for web artisans.☆31,329Updated this week
- Low-code platform for building business applications. Connect to databases, cloud storages, GraphQL, API endpoints, Airtable, Google shee…☆35,979Updated this week
- ✨ The Next Gen Airtable Alternative: No-Code Postgres☆18,945Updated this week
- AI Agents & MCPs & AI Workflow Automation • (280+ MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Age…☆15,777Updated this week
- Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.☆74,559Updated this week
- React Flow | Svelte Flow - Powerful open source libraries for building node-based UIs with React (https://reactflow.dev) or Svelte (https…☆30,447Updated last week
- 💬 Typebot is a powerful chatbot builder that you can self-host.☆8,943Updated last week
- Platform to build admin panels, internal tools, and dashboards. Integrates with 25+ databases and any API.☆37,425Updated this week
- React components to build charts and dashboards☆16,385Updated 6 months ago
- 🧙♀️ Move Fast and Break Nothing. End-to-end typesafe APIs made easy.☆37,783Updated this week
- Build system optimized for JavaScript and TypeScript, written in Rust☆28,132Updated this week
- The open-source notification Inbox infrastructure. E-mail, SMS, Push and Slack Integrations.☆37,252Updated this week
- Build like a team of hundreds_☆51,738Updated this week
- 🧩 The Browser Extension Framework☆12,032Updated this week
- Instant-loading web apps, without effort☆21,482Updated last week
- A toolchain for web projects, aimed to provide functionalities to maintain them. Biome offers formatter and linter, usable via CLI and LS…☆20,020Updated this week
- Neon: Serverless Postgres. We separated storage and compute to offer autoscaling, code-like database branching, and scale to zero.☆19,044Updated this week
- Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ in…☆116,733Updated this week
- The flexible backend for all your projects 🐰 Turn your DB into a headless CMS, admin panels, or apps with a custom UI, instant APIs, aut…☆31,611Updated this week
- The world's most flexible commerce platform.☆29,777Updated this week
- Web framework built on Web Standards☆25,114Updated last week
- ⚡ Next-gen Web Extension Framework☆7,423Updated this week
- Penpot: The open-source design tool for design and code collaboration☆39,041Updated this week