crawlab-team / crawlab
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
☆11,747Updated this week
Alternatives and similar repositories for crawlab
Users that are interested in crawlab are comparing it to the libraries listed below
Sorting:
- Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js☆3,443Updated 6 months ago
- Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…☆3,283Updated 2 months ago
- Intelligent proxy pool for Humans™ to extract content from the internet and build your own Large Language Models in this new AI era☆4,004Updated 2 months ago
- High available distributed ip proxy pool, powerd by Scrapy and Redis☆5,479Updated 2 years ago
- admin ui for scrapy/open source scrapinghub☆2,766Updated 2 years ago
- Pholcus is a distributed high-concurrency crawler software written in pure golang☆7,589Updated 2 years ago
- 定时任务管理系统☆6,079Updated last year
- 今日热榜，一个获取各大热门网站热门头条的聚合网站，使用Go语言编写，多协程异步快速抓取信息，预览//mo.fish☆4,699Updated 2 years ago
- Ip2region (2.0 - xdb) is a offline IP address manager framework and locator, support billions of data segments, ten microsecond searching…☆17,780Updated last week
- Python ProxyPool for web spider☆22,364Updated 3 months ago
- Sealos is a production-ready Kubernetes distribution that makes deployment simple and efficient. Instantly set up development environment…☆15,416Updated this week
- JumpServer is an open-source Privileged Access Management (PAM) tool that provides DevOps and IT teams with on-demand and secure access t…☆27,669Updated this week
- ShowDoc is a tool greatly applicable for an IT team to share documents online一个非常适合IT团队的在线API文档、技术文档工具☆12,504Updated last month
- INFO-SPIDER 是一个集众多数据源于一身的爬虫工具箱🧰，旨在安全快捷的帮助用户拿回自己的数据，工具代码开源，流程透明。支持数据源包括GitHub、QQ邮箱、网易邮箱、阿里邮箱、新浪邮箱、Hotmail邮箱、Outlook邮箱、京东、淘宝、支付宝、中国移动、中国联通…☆7,985Updated this week
- 🐳 A most popular sql audit platform for mysql☆8,664Updated this week
- 开源运维平台：面向中小型企业设计的轻量级无Agent的自动化运维平台，整合了主机管理、主机批量执行、主机在线终端、文件在线上传下载、应用发布部署、在线任务计划、配置中心、监控、报警等一系列功能。☆10,575Updated last month
- 🔥 Proxy is a high performance HTTP(S) proxies, SOCKS5 proxies,WEBSOCKET, TCP, UDP proxy server implemented by golang. Now, it supports …☆16,328Updated last month
- 一款轻量级、高性能、功能强大的内网穿透代理服务器。支持tcp、udp、socks5、http等几乎所有流量转发，可用来访问内网网站、本地支付接口调试、ssh访问、远程桌面，内网dns解析、内网socks5代理等等……，并带有功能强大的web管理端。a lightweight…☆32,506Updated 11 months ago
- 基于Gin + Vue + Element UI & Arco Design & Ant Design 的前后端分离权限管理系统脚手架（包含了：多租户的支持，基础用户管理功能，jwt鉴权，代码生成器，RBAC资源控制，表单构建，定时任务等）3分钟构建自己的中后台项目；项目…☆11,978Updated last month
- Nightingale for monitoring and alerting, just as Grafana for visualization.☆10,873Updated this week
- A Powerful HTTP API Gateway in pure golang！Goku API Gateway （中文名：悟空 API 网关）是一个基于 Golang开发的微服务网关，能够实现高性能 HTTP API 转发、服务编排、多租户管理、API 访问权限控制…☆3,129Updated 2 years ago
- A Powerful Spider(Web Crawler) System in Python.☆16,615Updated last year
- Article publishing platform that automatically distributes your articles to various media channels☆3,101Updated 2 years ago
- YApi 是一个可本地部署的、打通前后端及QA的、可视化的接口管理平台☆27,581Updated 9 months ago
- A Distributed, Fault-Tolerant Cron-Style Job System.☆2,921Updated 11 months ago
- Learn and understand Docker&Container technologies, with real DevOps practice!☆25,393Updated 4 months ago
- 本系统是集工单统计、任务钩子、权限管理、灵活配置流程与模版等等于一身的开源工单系统，当然也可以称之为工作流引擎。 致力于减少跨部门之间的沟通，自动任务的执行，提升工作效率与工作质量，减少不必要的工作量与人为出错率。☆6,428Updated last month
- ✨ Yao is an all-in-one application engine that enables developers to create web apps, REST APIs, business applications, and more, with AI…☆7,283Updated this week
- 基于搜狗微信搜索的微信公众号爬虫接口☆6,066Updated last year
- Golang实现的基于beego框架的接口在线文档管理系统☆7,587Updated last month