爬虫管理系统，支持集群，弹性伸缩。支持运行feapder、scrapy、selenium、playwright等各种框架及脚本
☆132Dec 2, 2024Updated last year
Alternatives and similar repositories for feaplat
Users that are interested in feaplat are comparing it to the libraries listed below
Sorting:
- 使用feapder爬虫框架开发的爬虫示例☆32Dec 3, 2022Updated 3 years ago
- 🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬…☆3,633Dec 19, 2025Updated 3 months ago
- feapder的管道扩展☆16Mar 6, 2023Updated 3 years ago
- 用户自由无束缚的分布式光速python爬虫函数执行框架,写法和性能远远暴击仿scrapy api式框架☆24Mar 5, 2026Updated 2 weeks ago
- scrapy-redis-sentinel 基于 scrapy-redis 的基础上 新增 哨兵（sentinel）连接模式 以及 集群（cluster）连接模式。☆30Mar 31, 2023Updated 2 years ago
- python 代码加密|加固☆208Dec 29, 2020Updated 5 years ago
- A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.☆94Jan 5, 2025Updated last year
- More flexible and featured Frontera scheduler for Scrapy☆36Jun 6, 2025Updated 9 months ago
- spider-admin-pro 一个集爬虫Scrapy+Scrapyd爬虫项目查看 和 爬虫任务定时调度的可视化管理工具，SpiderAdmin的升级版☆613Nov 10, 2024Updated last year
- Backend core modules for Crawlab☆51Jun 14, 2024Updated last year
- SpiderAdmin 一个集爬虫Scrapy+Scrapyd爬虫项目查看 和 爬虫任务定时调度的可视化管理工具☆96Jan 27, 2021Updated 5 years ago
- help you understand java memory world.(using private APIs in frida)☆24Sep 10, 2021Updated 4 years ago
- Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架☆12,177Feb 10, 2026Updated last month
- 量化交易策略回测研究平台——前端☆18Aug 13, 2021Updated 4 years ago
- 无压的浏览器书签管理插件☆13Jun 8, 2022Updated 3 years ago
- 可视编程机器学习平台 - 『人人可做的机器学习』-《智能数据挖掘》实战系列视频演示实验数据集与数据分析流☆20Mar 13, 2021Updated 5 years ago
- 爬虫管理系统,爬虫管理平台,分布式爬虫管理平台,可视化操作,完整监控,灵活的Python环境管理,,环境隔离,资源占用小,支持 Scrapy 等主流爬虫框架,支持 Selenium、Playwright、DrissionPage 等浏览器自动化工具,支持node环境下的js…☆179Jan 23, 2026Updated last month
- Dynamic configurable crawl (动态可配置化爬虫)☆86Jan 13, 2018Updated 8 years ago
- ☆12May 17, 2023Updated 2 years ago
- 基于httpx的一个大型项目 ，爬取黑胶唱片网站 Discogs☆102Jul 14, 2025Updated 8 months ago
- SpiderBox - 虫盒 - 爬虫逆向资源导航站☆139Updated this week
- Label Studio is a multi-type data labeling and annotation tool with standardized output format☆10Nov 17, 2021Updated 4 years ago
- Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…☆3,409Feb 19, 2025Updated last year
- Scrapy Pyppeteer Demo☆12Jul 30, 2020Updated 5 years ago
- HookCodeGenerator Plugin for IntelliJ IDEA. 适用于idea的hook代码生成器☆14Nov 28, 2023Updated 2 years ago
- Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js☆3,502Oct 29, 2024Updated last year
- FastAPI 项目脚手架，全异步方式实现，持续更新，内置crud 代码生成, 数据库管理器(sqlalchemy 2.0<postgresql>, redis, mongodb), 文件存储管理器(lcoal, 阿里云 oss, 七牛云 kobo), 日志模块, 等众多模…☆22Aug 29, 2024Updated last year
- 开源微信爬虫：爬取公众号所有 文章、阅读量、点赞量和评论内容。易部署。持续维护！！！☆2,772Mar 31, 2023Updated 2 years ago
- qxVm补环境框架(纯js实现)☆487Nov 25, 2024Updated last year
- 这是一个基于 FastAPI 的 浏览器 RPC 服务端☆60Aug 17, 2023Updated 2 years ago
- 帮助爬虫通过点选验证及滑动验证, 验证码识别☆100Sep 14, 2022Updated 3 years ago
- python3+django+django-rest-framework+vue+xadmin前后端分离电商平台☆10Dec 8, 2022Updated 3 years ago
- 网页版微信API，包含终端版微信及微信机器人☆13Oct 25, 2016Updated 9 years ago
- Set of examples to learn how to use toolium different functionalities☆11Feb 13, 2026Updated last month
- 一个用于自动生成和管理 Trae AI 项目规则文件的 MCP (Model Context Protocol) 服务☆14Jul 17, 2025Updated 8 months ago
- 狠心开源企业级舆情新闻爬虫项目：支持任意数量爬虫一键运行、爬虫定时任务、爬虫批量删除；爬虫一键部署；爬虫监控可视化; 配置集群爬虫分配策略；👉 现成的docker一键部署文档已为大家踩坑☆664Jan 12, 2024Updated 2 years ago
- ☆20Nov 29, 2020Updated 5 years ago
- 一个简易的unicorn tracer，剪裁自项目Rainbow。☆28Apr 8, 2021Updated 4 years ago
- SDK for Crawlab, including SDK for different programming languages such as Python, Node.js and Java, and a CLI Tool written in Python.☆58Jun 3, 2024Updated last year