爬虫管理系统,支持集群,弹性伸缩。支持运行feapder、scrapy、selenium、playwright等各种框架及脚本
☆133Dec 2, 2024Updated last year
Alternatives and similar repositories for feaplat
Users that are interested in feaplat are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单,功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬…☆3,736Aug 21, 2026Updated 2 months ago
- 使用feapder爬虫框架开发的爬虫示例☆32Dec 3, 2022Updated 3 years ago
- 用户自由无束缚的分布式光速python爬虫函数执行框架,写法和性能远远暴击仿scrapy api式框架☆26Mar 16, 2026Updated 7 months ago
- spider-admin-pro 一个集爬虫Scrapy+Scrapyd爬虫项目查看 和 爬虫任务定时调度的可视化管理工具,SpiderAdmin的升级版☆612Jun 15, 2026Updated 4 months ago
- python 代码加密|加固☆207Dec 29, 2020Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- scrapy-redis-sentinel 基于 scrapy-redis 的基础上 新增 哨兵(sentinel)连接模式 以及 集群(cluster)连接模式。☆30Mar 31, 2023Updated 3 years ago
- Backend core modules for Crawlab☆51Jun 14, 2024Updated 2 years ago
- A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.☆95Jan 5, 2025Updated last year
- 可以用于scrapydweb的scrapyd节点,使用pyppeteer,在scrapy中异步使用☆12Dec 8, 2022Updated 3 years ago
- Auto Extractor Module☆337Aug 19, 2024Updated 2 years ago
- 🕷️ DiscovAI Crawl API(🚧 Work in Progress 🚧): A powerful web scraping solution for AI tools and vector databases. Extract clean HTML, g…☆19Aug 5, 2024Updated 2 years ago
- More flexible and featured Frontera scheduler for Scrapy☆38Sep 17, 2026Updated last month
- 爬虫管理系统,爬虫管理平台,分布式爬虫管理平台, 流程编排,openclaw龙虾,AI助手,可视化操作,完整监控,灵活的Python环境管理,,环境隔离,资源占用小,支持 Scrapy 等主流爬虫框架,支持 Selenium、Playwright、DrissionPage …☆212Oct 9, 2026Updated 3 weeks ago
- An intelligent web service to automatically detect web content and extract information from it.☆86Jul 13, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Downloader Middleware to support Playwright in Scrapy & Gerapy☆111Mar 6, 2022Updated 4 years ago
- Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…☆3,408Feb 19, 2025Updated last year
- 无压的浏览器书签管理插件☆13Jun 8, 2022Updated 4 years ago
- 可视编程机器学习平台 - 『人人可做的机器学习』-《智能数据挖掘》实战系列视频演示实验数据集与数据分析流☆21Mar 13, 2021Updated 5 years ago
- 基于httpx的一个大型项目 ,爬取黑胶唱片网站 Discogs☆102Jul 14, 2025Updated last year
- 开源微信爬虫:爬取公众号所有 文章、阅读量、点赞量和评论内容。易部署。持续维护!!!☆2,985Aug 28, 2026Updated 2 months ago
- Label Studio is a multi-type data labeling and annotation tool with standardized output format☆10Nov 17, 2021Updated 4 years ago
- 一个简单的php危险函数检测工具☆10Dec 19, 2018Updated 7 years ago
- Scrapy Pyppeteer Demo☆12Jul 30, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 这是一个基于 FastAPI 的 浏览器 RPC 服务端☆59Aug 17, 2023Updated 3 years ago
- ☆20Nov 29, 2020Updated 5 years ago
- 极验滑动验证码研究报告☆68Jul 29, 2021Updated 5 years ago
- Download a webpage and all the external resources.☆12Dec 8, 2020Updated 5 years ago
- SpiderBox - 虫盒 - 爬虫逆向资源导航站☆158Updated this week
- HookCodeGenerator Plugin for IntelliJ IDEA. 适用于idea的hook代码生成器☆14Nov 28, 2023Updated 2 years ago
- 带带弟弟 通用验证码识别OCR pypi版☆14,888Mar 10, 2026Updated 7 months ago
- Scrapy and Kafka☆14Feb 7, 2018Updated 8 years ago
- 反洗钱使用黑名单数据爬取☆16Jul 7, 2015Updated 11 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- 新闻网页正文通用抽取器 Beta 版.☆3,804Apr 21, 2026Updated 6 months ago
- 通用新闻类网站分布式爬虫☆79Jul 17, 2018Updated 8 years ago
- 网页版微信API,包含终端版微信及微信机器人☆12Oct 25, 2016Updated 10 years ago
- 帮助爬虫通过点选验证及滑动验证, 验证码识别☆98Sep 14, 2022Updated 4 years ago
- 《爬虫逆向进阶实战》书籍代码库☆767Jan 26, 2026Updated 9 months ago
- 一个简易的unicorn tracer,剪裁自项目Rainbow。☆28Apr 8, 2021Updated 5 years ago
- Set of examples to learn how to use toolium different functionalities☆11Mar 31, 2026Updated 7 months ago