Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.
☆113Mar 13, 2023Updated 3 years ago
Alternatives and similar repositories for scraper
Users that are interested in scraper are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Web data extraction tool implemented as chrome extension with much more features☆48Oct 29, 2018Updated 7 years ago
- Web crawler/spider for node.js & nest.js server☆12Feb 12, 2026Updated 2 months ago
- A fork of the popular google chrome extension "The Great Suspender" without the malware.☆12Feb 8, 2021Updated 5 years ago
- ⚡ Building applications with LLMs through composability ⚡☆14Mar 10, 2023Updated 3 years ago
- A simple and fully customizable web crawler/spider for Node.js with server-side DOM. Comes with elegant and hell-simple APIs.☆25Jul 27, 2021Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An ecosystem of lightweight, modular, and performant libraries for building modern web applications, built around a push-pull based react…☆28Updated this week
- ☆10Jan 19, 2022Updated 4 years ago
- Groove, a crawling and unit test optimized MITM proxy server.☆19Dec 24, 2022Updated 3 years ago
- Convert JSON schema to mongoose 5 schema☆13Apr 10, 2026Updated last week
- A puppeteer-extra plugin to solve Amazon captchas using Tessaract.JS.☆15May 16, 2024Updated last year
- cli for evaluating css and xpath selectors☆29Jul 4, 2023Updated 2 years ago
- Extends the official Alpine JS $persist plugin with additional utilities to help you work with localStorage more effectively. This plugin…☆22Mar 7, 2025Updated last year
- Save your resources, reach them from anywhere☆17Jun 4, 2020Updated 5 years ago
- UI atomic component-based library with Storybook integration☆17Apr 13, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An Alpine JS Screen Plugin lets you programmatically monitor changes to the size of the screen☆21Dec 28, 2025Updated 3 months ago
- A simple multithreaded SSH credential tester.☆14Jun 6, 2025Updated 10 months ago
- Automatically extracts structured information from webpages☆111Jun 23, 2022Updated 3 years ago
- An open-source session replay tool for single-page applications that uses AI analysis, aggregated trends, and a RAG chatbot to help devel…☆11Jan 23, 2026Updated 2 months ago
- Kills gsScrollPos cookies made by The Great Suspender☆15Sep 5, 2018Updated 7 years ago
- Allegro Maild, an SMTP server written in Common Lisp☆17Nov 7, 2015Updated 10 years ago
- Alpine v3.x plugin to manually manage components at different breakpoints☆24Apr 4, 2022Updated 4 years ago
- Manage your machine setup.☆17Apr 13, 2026Updated last week
- GatsbyJS - Material Design by Creative-Tim | AppSeed☆10Dec 1, 2020Updated 5 years ago
- Deploy open-source AI quickly and easily - Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.☆70Jun 8, 2021Updated 4 years ago
- Crawler based on a modified browser to detect online tracking.☆11Jul 19, 2023Updated 2 years ago
- 🧱 A uniform template to use as a foundation for Puppeteer bot construction.☆69May 6, 2021Updated 4 years ago
- HTTP proxy with per-request uTLS fingerprint mimicry and upstream proxy tunneling. Currently WIP.☆50Jan 14, 2024Updated 2 years ago
- A modern, easy-to-use asset packer for Dart☆16Sep 4, 2021Updated 4 years ago
- Testing utilities with similar ergonomics to React testing library, but for Twig☆20Feb 3, 2022Updated 4 years ago
- Bullshit free personal CRM 🧑🤝🧑☆24Aug 25, 2025Updated 7 months ago
- Documentation for eBay sold items API☆13Updated this week
- OpenFaaS template for headless Chrome and Puppeteer☆91Feb 15, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A javascript based botnet/C&C to remotely manage/control browsers.☆24Feb 4, 2022Updated 4 years ago
- Telegram Terra LTV alerts bot☆10Jan 21, 2022Updated 4 years ago
- ☆11May 17, 2023Updated 2 years ago
- puppeteer as a service.☆38Aug 26, 2022Updated 3 years ago
- Chrome Dev Tools extension for XHR JSON based requests.☆13Feb 8, 2018Updated 8 years ago
- JavaScript code of many commercial bot detectors/fingerprinting services and string deobfuscators for them if applicable.☆134Jun 30, 2021Updated 4 years ago
- Shinobi Video plugin for DeepStack Object Detection☆17Nov 5, 2021Updated 4 years ago