xiyuan-fengyu / ppspiderLinks
web spider built by puppeteer, support task-queue and task-scheduling by decorators，support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架，提供灵活的任务队列管理调度方案，提供便捷的数据保存方案（nedb/mongodb），提供数据可视化和用户交互的实现方案
☆338Updated 4 years ago
Alternatives and similar repositories for ppspider
Users that are interested in ppspider are comparing it to the libraries listed below
Sorting:
- 爬取代理IP并进行测速分析，筛选出高速可用的ip☆237Updated 3 years ago
- Puppeteer, Headless Chrome；爬取《es6标准入门》、自动推文到掘金、站点性能分析；高级爬虫、自动化UI测试、性能分析；☆1,213Updated 5 years ago
- node-mitmproxy is an extensible man-in-the-middle(MITM) proxy server for HTTP/HTTPS base on Node.js.☆298Updated 3 years ago
- 📖 Puppeteer中文文档（官方指定的中文文档）☆809Updated 3 years ago
- 介绍操作 Chrome 浏览器无头模式的工具库 Puppeteer☆147Updated 8 years ago
- puppeteer 模拟用户滑动验证。文章点我↓↓↓↓↓↓↓↓↓↓↓↓↓↓↓↓↓↓↓↓ https://juejin.cn/post/6844903566289682440☆71Updated 3 years ago
- ☆195Updated 2 years ago
- Xenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a…☆124Updated 2 years ago
- nodejs 爬虫框架. crawler framework for nodejs☆41Updated 5 years ago
- a reliable high-level web crawling & scraping framework for Node.js.☆559Updated 9 months ago
- 基于wechaty-puppet-padplus的微信机器人助手☆93Updated 2 years ago
- 浏览器指纹 audio指纹，webgl指纹，canvas指纹的生成算法☆286Updated last year
- JavaScript 抽象语法树相关的理论知识和实战教程索引，帮助各位工程师掌握 AST 相关知识点和技术应用☆157Updated 5 years ago
- 基于puppeteer的电商商品数据爬虫工具☆125Updated 6 years ago
- CLI for create Chrome extension app☆63Updated 3 years ago
- JS获取设备信息(操作系统信息、地理位置、UUID、横竖屏状态、设备类型 、网络状态、浏览器信息、生成浏览器指纹、日期、生肖、周几等)☆255Updated 3 months ago
- Personal Payment Solution based on Wechaty☆222Updated 6 years ago
- 通过js获取浏览器指纹☆67Updated 5 years ago
- puppeteer 中文/国内解决方案☆32Updated 6 years ago
- 🇨🇳翻译: <awesome-puppeteer> Puppeteer 资源的精选列表 ❤️ 校对 ✅☆23Updated 6 years ago
- unpack wxapkg☆152Updated 8 years ago
- 基于Node.js的HTTPS MITM(中间人)代理的原理和实现☆463Updated 8 years ago
- The best javascript code protection solution ever.☆741Updated 4 years ago
- A crawler on taobao live barrages.☆149Updated 7 years ago
- 拾荒木偶 基于Electron+Puppeteer的可视化爬虫工具，无任何依赖。可视化浏览器自动化任务/采集/无代码/图形化/开源/操作简单/对抗反爬机制☆47Updated last year
- ☆243Updated 5 years ago
- 高质量免费代理池——每日1w+代理资源滚动更新☆313Updated 4 years ago
- 微信支付 SDK，支持刷卡支付、公众号支付、扫码支付、APP支付、H5支付，以及优惠券，红包，企业付款，微信代扣☆121Updated 6 years ago
- 使用 ADB 和 Node.js 训练抖音模型，自动关注抖音里好看的小姐姐☆79Updated 3 years ago
- 《反爬虫JS破解与混淆还原手册》 by @No-Attack @LoseNine。 一本教你JS破解以及混淆与还原的教程。欢迎star，持续更新。☆676Updated 6 months ago