apify / crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
☆15,667Updated this week
Related projects ⓘ
Alternatives and complementary repositories for crawlee
- 🧩 The Browser Extension Framework☆10,594Updated last week
- 🌌 A complete search engine and RAG pipeline in your browser, server or edge network with support for full-text, vector, and hybrid sear…☆8,712Updated this week
- Simple, open source, lightweight (< 1 KB) and privacy-friendly web analytics alternative to Google Analytics.☆20,489Updated this week
- 🦔 PostHog provides open-source web & product analytics, session recording, feature flagging and A/B testing that you can self-host. Get …☆22,013Updated this week
- highlight.io: The open source, full-stack monitoring platform. Error monitoring, session replay, logging, distributed tracing, and more.☆7,655Updated this week
- Platform to build admin panels, internal tools, and dashboards. Integrates with 25+ databases and any API.☆34,654Updated this week
- 🔥 🔥 🔥 Open Source JIRA, Linear, Monday, and Asana Alternative. Plane helps you track your issues, epics, and product roadmaps in the s…☆30,769Updated this week
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆12,091Updated this week
- ♾ Infisical is the open-source secret management platform: Sync secrets across your team/infrastructure, prevent secret leaks, and manage…☆15,680Updated this week
- Umami is a simple, fast, privacy-focused alternative to Google Analytics.☆22,897Updated this week
- 📊 Cube — The Semantic Layer for Building Data Applications☆17,955Updated this week
- Open Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch ⚡ 🔍 ✨ Fast, typo tolerant, in-memory fuz…☆21,156Updated this week
- Open-source developer platform to power your entire infra and turn scripts into webhooks, workflows and UIs. Fastest workflow engine (13x…☆10,922Updated this week
- Notion-style WYSIWYG editor with AI-powered autocompletion.☆13,144Updated 2 months ago
- Open Source Alternative to Vercel, Netlify and Heroku.☆9,248Updated this week
- Write components once, run everywhere. Compiles to React, Vue, Qwik, Solid, Angular, Svelte, and more.☆12,539Updated last week
- Lightweight WASM Postgres with real-time, reactive bindings.☆9,429Updated this week
- 🧑🚀 The better identity infrastructure for developers and the open-source alternative to Auth0.☆8,922Updated this week
- Open source alternative to Auth0 / Firebase Auth / AWS Cognito☆13,164Updated this week
- Visual Development for React, Vue, Svelte, Qwik, and more☆7,557Updated this week
- ✨ The Next Gen Airtable Alternative: No-Code Postgres☆13,097Updated this week
- Optimize React performance and make your React 70% faster in minutes, not months.☆16,410Updated 4 months ago
- Simple, powerful and flexible site generation framework with everything you love from Next.js.☆11,873Updated this week
- Low code platform for building business apps and workflows in minutes. Supports PostgreSQL, MySQL, MariaDB, MSSQL, MongoDB, Rest API, Doc…☆22,740Updated this week
- The headless rich text editor framework for web artisans.☆27,571Updated this week
- A fully open-source headless CMS that supports Markdown and Visual Editing☆12,008Updated this week
- Authentication for the Web.☆24,957Updated this week
- A free, open-source SaaS app starter for React & Node.js with superpowers. Full-featured. Community-driven.☆8,264Updated this week
- Building a modern alternative to Salesforce, powered by the community.☆20,681Updated this week
- A lightning-fast search API that fits effortlessly into your apps, websites, and workflow☆47,473Updated this week