web spider built by puppeteer, support task-queue and task-scheduling by decorators,support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架,提供灵活的任务队列管理调度方案,提供便捷的数据保存方案(nedb/mongodb),提供数据可视化和用户交互的实现方案
☆338Dec 10, 2021Updated 4 years ago
Alternatives and similar repositories for ppspider
Users that are interested in ppspider are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Xenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a…☆125Apr 15, 2023Updated 3 years ago
- Web Crawler/Spider for NodeJS + server-side jQuery ;-)☆6,796Jun 18, 2026Updated 3 months ago
- A mini program demo base on Electron (Electron桌面小程序)☆32Apr 16, 2022Updated 4 years ago
- XSS Tags & Attributes DB☆19Nov 23, 2020Updated 5 years ago
- 此项目为悠行简历在线简历网站(不包括后端接口),主要分为我的简历、简历修改、简历攻略、用户中心四大模块,用户可以使用简历模板创建简历、查看简历攻略和贴士、在线编辑简历并下载保存到本地、反馈意见和建议、修改基本信息和密码等。项目主要使用Vue+Vuex+Bootstrap实现…☆17Jan 15, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- crawler dev tools using electron webview☆15Jul 7, 2020Updated 6 years ago
- 基于 IKAnalyzer 字典分词器的 node.js 实现☆21Jan 20, 2017Updated 9 years ago
- Puppeteer, Headless Chrome;爬取《es6标准入门》、自动推文到掘金、站点性能分析;高级爬虫、自动化UI测试、性能分析;☆1,210Nov 13, 2020Updated 5 years ago
- TypeScript/Node.js implementation of a proxy server (think Squid) with support for SSL, HTTP/HTTPS, SOCKS5, authentication, and upstream …☆1,044Oct 5, 2026Updated last week
- a images viewer for vue.js / 基于Vue.js的图片预览查看器 编程式使用☆13Jan 6, 2023Updated 3 years ago
- win10 media ocr☆11Jun 22, 2021Updated 5 years ago
- Distributed crawler powered by Headless Chrome☆5,632Apr 29, 2023Updated 3 years ago
- 💯 Teach puppeteer new tricks through plugins.☆7,408Jul 18, 2024Updated 2 years ago
- A BurpSuite extension written by Python,used to find API interface in JS file.☆115Apr 28, 2026Updated 5 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A Java library for converting WOFF fonts to TTF☆12Oct 31, 2015Updated 10 years ago
- 蜂巢爬虫系统 是一套只需要定义XPath,就可实现爬取网站,APP的系统, 支持多种解析方式(XPath,正则表达式),多种下载方式(HttpClient库, PhantomJs, Selenium),多种输出方式(Excel,MongoDB)。 可不做任何修改发布到Yar…☆10Sep 5, 2016Updated 10 years ago
- 一个完整的typescript模块的样板库☆18Jan 30, 2020Updated 6 years ago
- ☆12May 7, 2023Updated 3 years ago
- [DEPRECATED] Simple, flexible, delightful web crawler/spider package☆37Feb 27, 2023Updated 3 years ago
- babel plugin for webpack☆13Jan 10, 2018Updated 8 years ago
- Node 9下import/export的丝般顺滑使用☆15Nov 17, 2017Updated 8 years ago
- ☆11Jan 6, 2020Updated 6 years ago
- 🚀 基于NestJs + TypeScript + TypeORM + Redis + MySql + Vue2 + Element-UI编写的一款简单高效的前后端分离的权限管理系统☆184Nov 13, 2022Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 网络爬虫类库,基本可以实现自定义规则大部分网站☆44Jul 8, 2019Updated 7 years ago
- 前端框架命名风格比较☆12Aug 5, 2017Updated 9 years ago
- 拾荒木偶 基于Electron+Puppeteer的可视化爬虫工具,无任何依赖。可视化浏 览器自动化任务/采集/无代码/图形化/开源/操作简单/对抗反爬机制☆48Nov 25, 2024Updated last year
- A curated list of awesome puppeteer resources.☆2,584Jul 19, 2024Updated 2 years ago
- 视频解析☆17Nov 13, 2025Updated 10 months ago
- GitHub automation driven by headless chrome.☆18Jul 11, 2020Updated 6 years ago
- xpath路径查看工具☆20Mar 5, 2018Updated 8 years ago
- 一个将interface转化为markdown文档的工具☆13Feb 11, 2021Updated 5 years ago
- check redos, reverse text from regular expression.☆12Mar 1, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 没有经过整理的知识才是徒然浪费时间,伤透脑筋!☆108Aug 27, 2019Updated 7 years ago
- 基于electron、umi、javascript的基础开发环境☆13Jun 16, 2021Updated 5 years ago
- JavaScript API for Chrome and Firefox☆95,680Updated this week
- dynamic crawler for web vulnerability scanner☆250Mar 15, 2026Updated 6 months ago
- Small tool for logging JavaScript errors via window.onerror event☆27Nov 18, 2013Updated 12 years ago
- 📖 Puppeteer中文文档(官方指定的中文文档)☆805Nov 30, 2022Updated 3 years ago
- cobalt strike 自启动脚本☆41Mar 19, 2017Updated 9 years ago