Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.
☆113Mar 13, 2023Updated 2 years ago
Alternatives and similar repositories for scraper
Users that are interested in scraper are comparing it to the libraries listed below
Sorting:
- ☆30Nov 5, 2023Updated 2 years ago
- Mobirise plugin using Google Firebase☆10Oct 6, 2017Updated 8 years ago
- Iframe Coordinator☆28Updated this week
- Python API & MCP server to find torrents programmatically☆20Feb 5, 2026Updated last month
- Web crawler/spider for node.js & nest.js server☆12Feb 12, 2026Updated 3 weeks ago
- Deploy static websites to the AWS Cloud using a single command.☆12Dec 30, 2022Updated 3 years ago
- Read and write DMN XML from JavaScript.☆14Feb 20, 2026Updated 2 weeks ago
- Save your resources, reach them from anywhere☆17Jun 4, 2020Updated 5 years ago
- An SSR, islands friendly, way to render ube components.☆15Jun 29, 2021Updated 4 years ago
- Groove, a crawling and unit test optimized MITM proxy server.☆19Dec 24, 2022Updated 3 years ago
- A simple and fully customizable web crawler/spider for Node.js with server-side DOM. Comes with elegant and hell-simple APIs.☆25Jul 27, 2021Updated 4 years ago
- OBO Metadata Ontology☆24Dec 5, 2025Updated 3 months ago
- Svelte components for data visualisation and utilities for data transformation.☆19Mar 26, 2024Updated last year
- 🌌 Imagegen (image generator) as a Service, built with Node.js, Docker, and DigitalOcean.☆16Jun 6, 2022Updated 3 years ago
- ☆17Dec 16, 2020Updated 5 years ago
- Real-time guardrails for Claude Code tool calls.☆61Feb 4, 2026Updated last month
- Simple utility to calculate the resource quota needed for your k8s deployment(s)☆27Dec 21, 2021Updated 4 years ago
- The central job processing module used in OpenFn v1.☆19Feb 18, 2025Updated last year
- llms.txt -> MCP converter and other tools for the adoption of the `llms.txt` standard☆48Jan 12, 2026Updated last month
- The Best Autofill Since Sliced Bread.☆22Feb 11, 2025Updated last year
- 🟨 AppSignal for JavaScript☆20Feb 28, 2026Updated last week
- ⚡️ Your own static URL shortener☆84Dec 5, 2025Updated 3 months ago
- Themis is a validation and processing library that helps you always make sure your data is correct.☆14Nov 18, 2022Updated 3 years ago
- Billing monitoring for SRE's. Automation to create alerts and actions based on Estimated Changes for AWS Accounts☆28Sep 29, 2021Updated 4 years ago
- Jupyter notebook for performing price predictions of stock data using Facebook's Prophet package.☆26Jul 16, 2019Updated 6 years ago
- RBAC in Kubernetes visualizer☆24Jun 11, 2019Updated 6 years ago
- A quick demo on how to make a knowledge based chatbot using OpenAI embedding and GPT-3 APIs☆26May 10, 2023Updated 2 years ago
- [WIP] An opinionated framework for building distributed domain driven systems using microservices architecture☆23Jul 17, 2021Updated 4 years ago
- Evaluation of DMN 1.1 decision tables, limited to S-FEEL (Simple Friendly Enough Expression Language)☆22Jun 2, 2022Updated 3 years ago
- Automatically extracts structured information from webpages☆112Jun 23, 2022Updated 3 years ago
- MIG Welder Controller☆10May 20, 2015Updated 10 years ago
- Pipes for MarkLogic DataHub is visual programming tool for MarkLogic Data Hub. It integrates with MarkLogic's Datahub and produces custom…☆14Jan 12, 2021Updated 5 years ago
- A SapientML plugin of SapientMLGenerator☆11Dec 23, 2025Updated 2 months ago
- ☆30Aug 15, 2024Updated last year
- support for non-linux platforms (tested on Darwin) and other misc updates☆43Jan 29, 2015Updated 11 years ago
- Executive coaching skill for planning your 2026 using research-backed process goals. Works with Claude Code and Claude.ai.☆28Jan 5, 2026Updated 2 months ago
- CloudPathSniffer is an open-source, easy to use and extensible Cloud Anomaly Detection platform designed to help security teams to find h…☆13Nov 30, 2023Updated 2 years ago
- Kvell creates Node.js applications with pre-defined configurations, app flow and abstractions.☆16Jan 5, 2023Updated 3 years ago
- Automated filament inking for creating colored filament for multi-color 3D printing.☆11Nov 11, 2022Updated 3 years ago