xiyuan-fengyu / ppspiderView external linksLinks
web spider built by puppeteer, support task-queue and task-scheduling by decorators，support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架，提供灵活的任务队列管理调度方案，提供便捷的数据保存方案（nedb/mongodb），提供数据可视化和用户交互的实现方案
☆339Dec 10, 2021Updated 4 years ago
Alternatives and similar repositories for ppspider
Users that are interested in ppspider are comparing it to the libraries listed below
Sorting:
- 网络爬虫类库,基本可以实现自定义规则大部分网站☆44Jul 8, 2019Updated 6 years ago
- Web Crawler/Spider for NodeJS + server-side jQuery ;-)☆6,782May 28, 2025Updated 8 months ago
- A mini program demo base on Electron (Electron桌面小程序)☆32Apr 16, 2022Updated 3 years ago
- Puppeteer, Headless Chrome；爬取《es6标准入门》、自动推文到掘金、站点性能分析；高级爬虫、自动化UI测试、性能分析；☆1,214Nov 13, 2020Updated 5 years ago
- A BurpSuite extension written by Python,used to find API interface in JS file.☆114Mar 13, 2023Updated 2 years ago
- A simple robust vlive downloader that collects meta data, subtitles and video streams and merges it into mkv files☆13Jul 12, 2023Updated 2 years ago
- Node.js implementation of a proxy server (think Squid) with support for SSL, HTTP/HTTPS, SOCKS5, authentication, and upstream proxy chain…☆978Jan 17, 2026Updated last month
- Puppeteer Pool, run a cluster of instances in parallel☆3,511Feb 1, 2026Updated 2 weeks ago
- Xenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a…☆124Apr 15, 2023Updated 2 years ago
- ☆11Jan 6, 2020Updated 6 years ago
- A demo using mux.js to play .ts stream in HTML5☆10Mar 6, 2019Updated 6 years ago
- 蜂巢爬虫系统 是一套只需要定义XPath，就可实现爬取网站,APP的系统, 支持多种解析方式（XPath,正则表达式），多种下载方式（HttpClient库, PhantomJs, Selenium）,多种输出方式（Excel，MongoDB）。 可不做任何修改发布到Yar…☆10Sep 5, 2016Updated 9 years ago
- TypeScript 算法练习。☆12Dec 7, 2023Updated 2 years ago
- 拾荒木偶 基于Electron+Puppeteer的可视化爬虫工具，无任何依赖。可视化浏览器自动化任务/采集/无代码/图形化/开源/操作简单/对抗反爬机制☆48Nov 25, 2024Updated last year
- GraphQL Schema Bindings is a flexible and scalable GraphQL schema generator that exposes common object oriented patterns to your GraphQL …☆13Sep 17, 2025Updated 5 months ago
- Python code generator for Mozilla Parser AST☆11Feb 28, 2023Updated 2 years ago
- 基于node puppeteer的微博爬虫，目标在于实现自动登录，根据关键词检索内容，发送内容数据到服务器☆14Jan 21, 2022Updated 4 years ago
- strapi.io 官方文档 中文翻译☆10Apr 9, 2021Updated 4 years ago
- taro版个税小程序☆12Oct 12, 2018Updated 7 years ago
- 🚀 基于NestJs + TypeScript + TypeORM + Redis + MySql + Vue2 + Element-UI编写的一款简单高效的前后端分离的权限管理系统☆184Nov 13, 2022Updated 3 years ago
- 一个将interface转化为markdown文档的工具☆13Feb 11, 2021Updated 5 years ago
- ☆12May 7, 2023Updated 2 years ago
- Web front-end toolkit based on TypeScript☆13Oct 31, 2025Updated 3 months ago
- Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架☆12,156Feb 10, 2026Updated last week
- XSS Tags & Attributes DB☆19Nov 23, 2020Updated 5 years ago
- High performance, simple Go web framework☆67Jul 28, 2025Updated 6 months ago
- Next.js Tailwind Strapi 实现的简易微博☆14Feb 4, 2023Updated 3 years ago
- package.js Generator☆14Aug 22, 2015Updated 10 years ago
- babel plugin for webpack☆13Jan 10, 2018Updated 8 years ago
- nodejs 爬虫☆12Mar 28, 2019Updated 6 years ago
- crawler dev tools using electron webview☆15Jul 7, 2020Updated 5 years ago
- Github action for computing javascript bundle size. It calculates & logs JavaScript bundle size on each pull request or commit (customisa…☆16May 8, 2023Updated 2 years ago
- 针对weex 的二次开发框架eros 做的一个热更新check／add／download zip的一个服务端☆20Feb 13, 2018Updated 8 years ago
- A simple CLI tool to view the graph of events and actions☆13Nov 15, 2017Updated 8 years ago
- GitHub automation driven by headless chrome.☆18Jul 11, 2020Updated 5 years ago
- Preact+hook源码解析☆15Dec 29, 2019Updated 6 years ago
- 基于VUE框架做的微信公众号模版，可用于项目对接公众号自定义菜单功能的时候使用☆13Nov 12, 2018Updated 7 years ago
- vue router API for uni-app 框架☆15Oct 19, 2023Updated 2 years ago
- A curated list of awesome puppeteer resources.☆2,541Jul 19, 2024Updated last year