Alternatives and similar repositories for crawlab

Users that are interested in crawlab are comparing it to the libraries listed below

• Gerapy / Gerapy
  Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
  ☆3,481Updated 11 months ago
• andeya / pholcus
  Pholcus is a distributed high-concurrency crawler software written in pure golang
  ☆7,608Updated 2 years ago
• my8100 / scrapydweb
  Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…
  ☆3,336Updated 7 months ago
• imWildCat / scylla
  Intelligent proxy pool for Humans™ to extract content from the internet and build your own Large Language Models in this new AI era
  ☆4,017Updated 3 months ago
• GeneralNewsExtractor / GeneralNewsExtractor
  新闻网页正文通用抽取器 Beta 版.
  ☆3,757Updated 4 months ago
• tophubs / TopList
  今日热榜，一个获取各大热门网站热门头条的聚合网站，使用Go语言编写，多协程异步快速抓取信息，预览//mo.fish
  ☆4,716Updated 2 years ago
• SpiderClub / haipproxy
  High available distributed ip proxy pool, powerd by Scrapy and Redis
  ☆5,490Updated 2 years ago
• binux / pyspider
  A Powerful Spider(Web Crawler) System in Python.
  ☆16,907Updated last year
• XiaoMi / soar
  SQL Optimizer And Rewriter
  ☆8,755Updated last year
• ssssssss-team / spider-flow
  新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。
  ☆10,968Updated 2 years ago
• luyishisi / Anti-Anti-Spider
  越来越多的网站具有反爬虫特性，有的用图片隐藏关键数据，有的使用反人类的验证码，建立反反爬虫的代码仓库，通过与不同特性的网站做斗争（无恶意）提高技术。（欢迎提交难以采集的网站）（因工作原因，项目暂停）
  ☆7,295Updated 3 years ago
• labring / sealos
  The Intelligent Cloud OS. Use AI to automate the full lifecycle of your development and production environments, from provisioning custom…
  ☆16,406Updated last week
• wechaty / wechaty
  Conversational RPA SDK for Chatbot Makers. Join our Discord: https://discord.gg/7q8NBZbQzt
  ☆21,979Updated 3 months ago
• ouqiang / gocron
  定时任务管理系统
  ☆6,195Updated last year
• chyroc / WechatSogou
  基于搜狗微信搜索的微信公众号爬虫接口
  ☆6,126Updated last year
• go-rod / rod
  A Chrome DevTools Protocol driver for web automation and scraping.
  ☆6,288Updated last week
• eolinker / goku_lite
  A Powerful HTTP API Gateway in pure golang！Goku API Gateway （中文名：悟空 API 网关）是一个基于 Golang开发的微服务网关，能够实现高性能 HTTP API 转发、服务编排、多租户管理、API 访问权限控制…
  ☆3,135Updated 2 years ago
• crawlab-team / artipub
  Article publishing platform that automatically distributes your articles to various media channels
  ☆3,144Updated 3 weeks ago
• kangvcar / InfoSpider
  INFO-SPIDER 是一个集众多数据源于一身的爬虫工具箱🧰，旨在安全快捷的帮助用户拿回自己的数据，工具代码开源，流程透明。支持数据源包括GitHub、QQ邮箱、网易邮箱、阿里邮箱、新浪邮箱、Hotmail邮箱、Outlook邮箱、京东、淘宝、支付宝、中国移动、中国联通…
  ☆8,104Updated 2 months ago
• wkunzhi / Python3-Spider
  Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️
  ☆3,271Updated last year
• snail007 / goproxy
  🔥 Proxy is a high performance HTTP(S) proxies, SOCKS5 proxies,WEBSOCKET, TCP, UDP proxy server implemented by golang. Now, it supports …
  ☆16,676Updated last month
• ginuerzh / gost
  GO Simple Tunnel - a simple tunnel written in golang
  ☆17,165Updated 9 months ago
• jhao104 / proxy_pool
  Python ProxyPool for web spider
  ☆22,840Updated 7 months ago
• davideuler / architecture.of.internet-product
  互联网公司技术架构，微信/淘宝/微博/腾讯/阿里/美团点评/百度/OpenAI/Google/Facebook/Amazon/eBay的架构，欢迎PR补充
  ☆20,547Updated last year
• cnbattle / douyin
  抖音推荐/搜索页视频列表视频爬虫方案,基于app(虚拟机或真机) 相关技术 golang adb
  ☆1,181Updated 3 weeks ago
• scrapinghub / portia
  Visual scraping for Scrapy
  ☆9,455Updated last year
• chai2010 / advanced-go-programming-book
  《Go语言高级编程》开源图书，涵盖CGO、Go汇编语言、RPC实现、Protobuf插件实现、Web框架实现、分布式系统等高阶主题(完稿)
  ☆19,903Updated 2 months ago
• ehang-io / nps
  一款轻量级、高性能、功能强大的内网穿透代理服务器。支持tcp、udp、socks5、http等几乎所有流量转发，可用来访问内网网站、本地支付接口调试、ssh访问、远程桌面，内网dns解析、内网socks5代理等等……，并带有功能强大的web管理端。a lightweight…
  ☆33,457Updated last year
• Boris-code / feapder
  🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬…
  ☆3,416Updated 6 months ago
• go-kratos / kratos
  Your ultimate Go microservices framework for the cloud-native era.
  ☆24,947Updated this week