crawlab-team / crawlab-liteView external linksLinks
Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台
☆230Feb 9, 2023Updated 3 years ago
Alternatives and similar repositories for crawlab-lite
Users that are interested in crawlab-lite are comparing it to the libraries listed below
Sorting:
- Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架☆12,151Dec 5, 2025Updated 2 months ago
- SDK for Crawlab, including SDK for different programming languages such as Python, Node.js and Java, and a CLI Tool written in Python.☆58Jun 3, 2024Updated last year
- Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js☆3,500Oct 29, 2024Updated last year
- 基于springcloud开发的分布式美剧订阅系统(含爬虫)☆17Jun 20, 2023Updated 2 years ago
- gin+gorm+redis+全文搜索引擎 打造的超轻快速的应用级bbs☆216May 5, 2023Updated 2 years ago
- Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…☆3,403Feb 19, 2025Updated 11 months ago
- 可视化任务调度系统，精简到一个二进制文件 (Web visual task scheduler system , yes ! just one binary solve all the problems !)☆194Jan 11, 2026Updated last month
- a tiny iothub, simple and useful. 轻量的 iothub，用经典的物模型简化 iot 应用开发 device-shadow, iot, iothub, job, lightweight, mqtt, mysql, shadow, sqlit…☆32May 16, 2025Updated 8 months ago
- 基于goframe实现的日志中心平台，汇总其他平台通过TCP上报的数据、分析、查询☆52Mar 23, 2020Updated 5 years ago
- SpiderAdmin 一个集爬虫Scrapy+Scrapyd爬虫项目查看 和 爬虫任务定时调度的可视化管理工具☆96Jan 27, 2021Updated 5 years ago
- 对基于golang的henrylee2cn/pholcusl爬虫框架的修复和完善，满足自身需要☆25Oct 11, 2023Updated 2 years ago
- 一款分布式爬虫平台，帮助你更好的管理和开发爬虫。 内置一套爬虫定义规则（模版），可使用模版快速定义爬虫，也可当作框架手动开发爬虫。(兴趣使然的项目，用的不爽了就更新)☆161Dec 26, 2017Updated 8 years ago
- douyin api,抖音上传接口,抖音接口，抖音搬家，视频备份☆19Aug 9, 2020Updated 5 years ago
- 一款基于SVM算法的智能法律助手-前端☆26Dec 31, 2022Updated 3 years ago
- 可以用于scrapydweb的scrapyd节点，使用pyppeteer，在scrapy中异步使用☆12Dec 8, 2022Updated 3 years ago
- Goroutine local storage library☆10Apr 27, 2018Updated 7 years ago
- JSONP Go http middleware☆15Aug 9, 2017Updated 8 years ago
- 微信公众号文章爬虫，爬取公众号文章信息，用来获取到公众号的最新文章（支持爬取多个公众号），但本项目不支持获取到文章点赞数，和阅读量☆25Apr 11, 2024Updated last year
- php+swoole 的 shadowsocks OTA/UDP 版本实现☆23May 30, 2018Updated 7 years ago
- High Quality Api Getaway☆97Dec 30, 2022Updated 3 years ago
- simple http(s) proxy with python based sqlmapapi wrapper☆10Jul 20, 2015Updated 10 years ago
- taro版个税小程序☆12Oct 12, 2018Updated 7 years ago
- 快速、轻量级、跨平台、自动化API框架☆13Aug 18, 2024Updated last year
- An interactive resume-making tool☆10Mar 4, 2022Updated 3 years ago
- 微信小程序直播项目(类似于微信视频通话)☆12Oct 14, 2018Updated 7 years ago
- File manager web server based on Node.js with Koa, Angular.js and Bootstrap, updated to use a recent Koa and be mount compatible and is r…☆13May 10, 2022Updated 3 years ago
- 书籍《Python3 反爬虫原理与绕过实战》配套代码☆628Oct 25, 2021Updated 4 years ago
- An encoder for Go structs to HTML☆30Nov 5, 2021Updated 4 years ago
- Downloader Middleware to support Pyppeteer in Scrapy & Gerapy☆136Dec 27, 2021Updated 4 years ago
- Account Pool☆50Aug 31, 2023Updated 2 years ago
- golang实现的爬虫框架，使用者只需关心页面规则，提供web管理界面。基于colly开发。☆418Feb 25, 2023Updated 2 years ago
- 新闻网页正文通用抽取器 Beta 版.☆3,770May 22, 2025Updated 8 months ago
- My blog for golang☆10Apr 2, 2020Updated 5 years ago
- A simple PHP torrent tracker web UI.☆14Feb 28, 2017Updated 8 years ago
- create strong passwords online☆14Jan 31, 2026Updated last week
- 小鹅通下载自己订阅的视频,方便离线观看☆14Nov 10, 2023Updated 2 years ago
- 使用sklearn库调用knn算法实现猫眼字体识别☆12Nov 12, 2019Updated 6 years ago
- A developer-friendly tool for transfering sql statement to go struct.☆541Dec 29, 2023Updated 2 years ago
- boris-spider是一款使用Python语言编写的爬虫框架，于多年的爬虫业务中不断磨合而诞生，相比于scrapy，该框架更易上手，且又满足复杂的需求，支持分布式及批次采集。☆85Jan 21, 2022Updated 4 years ago