Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
☆12,186Feb 10, 2026Updated 2 months ago
Alternatives and similar repositories for crawlab
Users that are interested in crawlab are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js☆3,495Oct 29, 2024Updated last year
- Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…☆3,403Feb 19, 2025Updated last year
- Elegant Scraper and Crawler Framework for Golang☆25,221Updated this week
- Python ProxyPool for web spider☆23,263Mar 27, 2026Updated 2 weeks ago
- 新闻网页正文通用抽取器 Beta 版.☆3,773Mar 8, 2026Updated last month
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Pholcus is a distributed high-concurrency crawler software written in pure golang☆7,597Mar 3, 2026Updated last month
- 一款轻量级、高性能、功能强大的内网穿透代理服务器。支持tcp、udp、socks5、http等几乎所有流量转发，可用来访问内网网站、本地支付接口调试、ssh访问、远程桌面，内网dns解析、内网socks5代理等等……，并带有功能强大的web管理端。a lightweight…☆34,022May 30, 2024Updated last year
- Your ultimate Go microservices framework for the cloud-native era.☆25,590Apr 4, 2026Updated last week
- 🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬…☆3,654Apr 3, 2026Updated last week
- 🚀Vite+Vue3+Gin拥有AI辅助的基础开发平台，企业级业务AI+开发解决方案，内置mcp辅助服务，内置skills管理，支持TS和JS混用。它集成了JWT鉴权、权限管理、动态路由、显隐可控组件、分页封装、多点登录拦截、资源权限、上传下载、代码生成器、表单生成器和可…☆24,552Updated this week
- admin ui for scrapy/open source scrapinghub☆2,778May 4, 2023Updated 2 years ago
- 今日热榜，一个获取各大热门网站热门头条的聚合网站，使用Go语言编写，多协程异步快速抓取信息，预览//mo.fish☆4,731Feb 23, 2023Updated 3 years ago
- 定时任务管理系统☆6,248Mar 27, 2024Updated 2 years ago
- A golang framework helps gopher to build a data visualization and admin panel in ten minutes☆8,947Jun 24, 2025Updated 9 months ago
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- A fast reverse proxy to help you expose a local server behind a NAT or firewall to the internet.☆105,781Mar 29, 2026Updated 2 weeks ago
- A powerful framework for faster, easier, and more efficient project development.☆13,097Mar 24, 2026Updated 2 weeks ago
- 开源运维平台：面向中小型企业设计的轻量级无Agent的自动化运维平台，整合了主机管理、主机批量执行、主机在线终端、文件在线上传下载、应用发布部署、在线任务计划、配置中心、监控、报警等一系列功能。☆10,977Mar 8, 2026Updated last month
- 🔥 Proxy is a high performance HTTP(S) proxies, SOCKS5 proxies,WEBSOCKET, TCP, UDP proxy server implemented by golang. Now, it supports …☆16,942Sep 2, 2025Updated 7 months ago
- Sealos is an AI-native Cloud Operating System built on Kubernetes that unifies the entire application lifecycle, from development in clou…☆17,227Updated this week
- A cloud-native Go microservices framework with cli tool for productivity.☆32,893Updated this week
- 基于Gin + Vue + Element UI & Arco Design & Ant Design 的前后端分离权限管理系统脚手架（包含了：多租户的支持，基础用户管理功能，jwt鉴权，代码生成器，RBAC资源控制，表单构建，定时任务等）3分钟构建自己的中后台项目；项目…☆12,603Sep 10, 2025Updated 7 months ago
- 👾 Fast and simple video download library and CLI tool written in Go☆31,005Mar 29, 2026Updated 2 weeks ago
- JumpServer is an open-source Privileged Access Management (PAM) platform that provides DevOps and IT teams with on-demand and secure acce…☆30,275Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 《Go语言高级编程》开源图书，涵盖CGO、Go汇编语言、RPC实现、Protobuf插件实现、Web框架实现、分布式系统等高阶主题(完稿)☆20,061Oct 7, 2025Updated 6 months ago
- Article publishing platform that automatically distributes your articles to various media channels☆3,194Jan 29, 2026Updated 2 months ago
- YApi 是一个可本地部署的、打通前后端及QA的、可视化的接口管理平台☆27,733Aug 12, 2024Updated last year
- A Powerful Spider(Web Crawler) System in Python.☆16,938Apr 30, 2024Updated last year
- Weekly Go Online Meetup via Bilibili｜Go 夜读｜通过 bilibili 在线直播的方式分享 Go 相关的技术话题，每天大家在微信/telegram/Slack 上及时沟通交流编程技术话题。☆12,309Mar 10, 2026Updated last month
- A Go microservices framework☆22,726Mar 26, 2026Updated 2 weeks ago
- 😮python模拟登陆一些大型网站，还有一些简单的爬虫，希望对你们有所帮助❤️，如果喜欢记得给个star哦🌟☆16,237Jul 26, 2022Updated 3 years ago
- High available distributed ip proxy pool, powerd by Scrapy and Redis☆5,578Dec 26, 2022Updated 3 years ago
- 《The Way to Go》中文译本，中文正式名《Go 入门指南》☆35,141Aug 14, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。☆11,320Jun 14, 2023Updated 2 years ago
- 🐜🐜🐜 ants is the most powerful and reliable pooling solution for Go.☆14,379Apr 1, 2026Updated last week
- 🐳 A most popular sql audit platform for mysql☆8,937Oct 13, 2025Updated 6 months ago
- Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台☆230Feb 9, 2023Updated 3 years ago
- Ip2region is an offline IP-to-Region localization library and IP data management framework with both IPv4 and IPv6 supports, 10-microseco…☆18,910Updated this week
- 🌩 Self-hosted file management and sharing system, supports multiple storage providers☆27,345Mar 30, 2026Updated last week
- Gin is a high-performance HTTP web framework written in Go. It provides a Martini-like API but with significantly better performance—up t…☆88,353Mar 31, 2026Updated last week