web spider built by puppeteer, support task-queue and task-scheduling by decorators，support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架，提供灵活的任务队列管理调度方案，提供便捷的数据保存方案（nedb/mongodb），提供数据可视化和用户交互的实现方案
☆339Dec 10, 2021Updated 4 years ago
Alternatives and similar repositories for ppspider
Users that are interested in ppspider are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Additional module to use with 'puppeteer' for setting proxies per page basis.☆449Jun 9, 2024Updated last year
- Tools for protecting your javascript code in browser.☆16Jan 4, 2023Updated 3 years ago
- Proxies Puppeteer Page requests.☆215Aug 28, 2024Updated last year
- A web spider framework☆28Dec 8, 2023Updated 2 years ago
- Xenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a…☆124Apr 15, 2023Updated 2 years ago
- NordVPN Threat Protection Pro™ • AdTake your cybersecurity to the next level. Block phishing, malware, trackers, and ads. Lightweight app that works with all browsers.
- Web Crawler/Spider for NodeJS + server-side jQuery ;-)☆6,792May 28, 2025Updated 10 months ago
- nodejs 爬虫框架. crawler framework for nodejs☆41Dec 24, 2020Updated 5 years ago
- Puppeteer Pool, run a cluster of instances in parallel☆3,514Mar 1, 2026Updated last month
- Puppeteer, Headless Chrome；爬取《es6标准入门》、自动推文到掘金、站点性能分析；高级爬虫、自动化UI测试、性能分析；☆1,212Nov 13, 2020Updated 5 years ago
- 网络爬虫类库,基本可以实现自定义规则大部分网站☆44Jul 8, 2019Updated 6 years ago
- Node.js implementation of a proxy server (think Squid) with support for SSL, HTTP/HTTPS, SOCKS5, authentication, and upstream proxy chain…☆987Feb 17, 2026Updated last month
- Distributed crawler powered by Headless Chrome☆5,699Apr 29, 2023Updated 2 years ago
- 💯 Teach puppeteer new tricks through plugins.☆7,294Jul 18, 2024Updated last year
- https://github.com/zcbenz/nw-sample-apps/tree/master/file-explorer for electron☆14Sep 25, 2015Updated 10 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 蜂巢爬虫系统 是一套只需要定义XPath，就可实现爬取网站,APP的系统, 支持多种解析方式（XPath,正则表达式），多种下载方式（HttpClient库, PhantomJs, Selenium）,多种输出方式（Excel，MongoDB）。 可不做任何修改发布到Yar…☆10Sep 5, 2016Updated 9 years ago
- 一个完整的typescript模块的样板库☆18Jan 30, 2020Updated 6 years ago
- [DEPRECATED] Simple, flexible, delightful web crawler/spider package☆37Feb 27, 2023Updated 3 years ago
- Node 9下import/export的丝般顺滑使用☆15Nov 17, 2017Updated 8 years ago
- 🚀 基于NestJs + TypeScript + TypeORM + Redis + MySql + Vue2 + Element-UI编写的一款简单高效的前后端分离的权限管理系统☆182Nov 13, 2022Updated 3 years ago
- 基于阿里云盘的文件分享平台☆21Dec 5, 2023Updated 2 years ago
- 拾荒木偶 基于Electron+Puppeteer的可视化爬虫工具，无任何依赖。可视化浏览器自动化任务/采集/无代码/图形化/开源/操作简单/对抗反爬机制☆48Nov 25, 2024Updated last year
- 💾 一个跨 JS 平台的缓存库，支持缓存逻辑代理，支持自定义数据存储☆16Oct 1, 2020Updated 5 years ago
- A curated list of awesome puppeteer resources.☆2,549Jul 19, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Vite + React + TypeScript + Ant Design 管理后台☆14Jul 23, 2025Updated 8 months ago
- Vue 热图组件 ，Vue 热区图选择☆16Apr 6, 2023Updated 3 years ago
- 视频解析☆17Nov 13, 2025Updated 4 months ago
- 一个将interface转化为markdown文档的工具☆13Feb 11, 2021Updated 5 years ago
- 简单的微信小程序Storage相关的封装, 特点是安全的数据源, 有效的存储时间☆14Apr 8, 2019Updated 7 years ago
- 📖 Puppeteer中文文档（官方指定的中文文档）☆807Nov 30, 2022Updated 3 years ago
- strapi.io 官方文档 中文翻译☆10Apr 9, 2021Updated 5 years ago
- a simple terminal tool for stock query written in Rust☆15Mar 15, 2023Updated 3 years ago
- check redos, reverse text from regular expression.☆12Mar 1, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- nodejs 爬虫☆12Mar 28, 2019Updated 7 years ago
- 基于electron、umi、javascript的基础开发环境☆13Jun 16, 2021Updated 4 years ago
- dynamic crawler for web vulnerability scanner☆251Mar 15, 2026Updated 3 weeks ago
- How to detect puppeteer with 100% accuracy☆109May 30, 2021Updated 4 years ago
- Tencent Wechat client GPS hook with Xposed☆19Apr 25, 2017Updated 8 years ago
- 前端监控：定时监控站点渲染情况，记录异常并保存截图: puppeteer, thinkjs,mongodb,headless-chrome,vuejs☆96Oct 11, 2017Updated 8 years ago
- Use case-driven examples for using Puppeteer and headless chrome☆2,411Mar 29, 2026Updated 2 weeks ago