Alternatives and similar repositories for crawlab

Users that are interested in crawlab are comparing it to the libraries listed below

• Gerapy / Gerapy
  Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
  ☆3,469Updated 9 months ago
• my8100 / scrapydweb
  Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…
  ☆3,319Updated 5 months ago
• GeneralNewsExtractor / GeneralNewsExtractor
  新闻网页正文通用抽取器 Beta 版.
  ☆3,749Updated 2 months ago
• andeya / pholcus
  Pholcus is a distributed high-concurrency crawler software written in pure golang
  ☆7,603Updated 2 years ago
• DormyMo / SpiderKeeper
  admin ui for scrapy/open source scrapinghub
  ☆2,767Updated 2 years ago
• lionsoul2014 / ip2region
  Ip2region (2.0 - xdb) is a offline IP address manager framework and locator, support billions of data segments, ten microsecond searching…
  ☆18,007Updated 2 weeks ago
• ssssssss-team / spider-flow
  新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。
  ☆10,707Updated 2 years ago
• SpiderClub / haipproxy
  High available distributed ip proxy pool, powerd by Scrapy and Redis
  ☆5,490Updated 2 years ago
• YaoApp / yao
  ✨ Yao is an all-in-one application engine that enables developers to create web apps, REST APIs, business applications, and more, with AI…
  ☆7,362Updated this week
• imWildCat / scylla
  Intelligent proxy pool for Humans™ to extract content from the internet and build your own Large Language Models in this new AI era
  ☆4,014Updated last month
• wechaty / wechaty
  Conversational RPA SDK for Chatbot Makers. Join our Discord: https://discord.gg/7q8NBZbQzt
  ☆21,793Updated last month
• crawlab-team / artipub
  Article publishing platform that automatically distributes your articles to various media channels
  ☆3,115Updated 2 years ago
• tophubs / TopList
  今日热榜，一个获取各大热门网站热门头条的聚合网站，使用Go语言编写，多协程异步快速抓取信息，预览//mo.fish
  ☆4,710Updated 2 years ago
• openimsdk / open-im-server
  IM Chat ChatGPT
  ☆15,066Updated last week
• labring / sealos
  Sealos is an AI-native, application-centric cloud operating system that powers intelligent super applications. Set up development environ…
  ☆16,051Updated this week
• Kr1s77 / awesome-python-login-model
  😮python模拟登陆一些大型网站，还有一些简单的爬虫，希望对你们有所帮助❤️，如果喜欢记得给个star哦🌟
  ☆16,161Updated 3 years ago
• iawia002 / lux
  👾 Fast and simple video download library and CLI tool written in Go
  ☆29,933Updated last month
• ccfos / nightingale
  Nightingale for monitoring and alerting, just as Grafana for visualization.
  ☆11,231Updated this week
• gocolly / colly
  Elegant Scraper and Crawler Framework for Golang
  ☆24,499Updated last month
• snail007 / goproxy
  🔥 Proxy is a high performance HTTP(S) proxies, SOCKS5 proxies,WEBSOCKET, TCP, UDP proxy server implemented by golang. Now, it supports …
  ☆16,495Updated last month
• chyroc / WechatSogou
  基于搜狗微信搜索的微信公众号爬虫接口
  ☆6,095Updated last year
• binux / pyspider
  A Powerful Spider(Web Crawler) System in Python.
  ☆16,737Updated last year
• jhao104 / proxy_pool
  Python ProxyPool for web spider
  ☆22,669Updated 5 months ago
• luyishisi / Anti-Anti-Spider
  越来越多的网站具有反爬虫特性，有的用图片隐藏关键数据，有的使用反人类的验证码，建立反反爬虫的代码仓库，通过与不同特性的网站做斗争（无恶意）提高技术。（欢迎提交难以采集的网站）（因工作原因，项目暂停）
  ☆7,300Updated 3 years ago
• ouqiang / gocron
  定时任务管理系统
  ☆6,168Updated last year
• go-rod / rod
  A Chrome DevTools Protocol driver for web automation and scraping.
  ☆6,127Updated 7 months ago
• openspug / spug
  开源运维平台：面向中小型企业设计的轻量级无Agent的自动化运维平台，整合了主机管理、主机批量执行、主机在线终端、文件在线上传下载、应用发布部署、在线任务计划、配置中心、监控、报警等一系列功能。
  ☆10,716Updated 3 months ago
• ehang-io / nps
  一款轻量级、高性能、功能强大的内网穿透代理服务器。支持tcp、udp、socks5、http等几乎所有流量转发，可用来访问内网网站、本地支付接口调试、ssh访问、远程桌面，内网dns解析、内网socks5代理等等……，并带有功能强大的web管理端。a lightweight…
  ☆33,213Updated last year
• fangzesheng / free-api
  收集免费的接口服务,做一个api的搬运工
  ☆15,527Updated last month
• sfyc23 / EverydayWechat
  微信助手：1.每日定时给好友（女友）发送定制消息。2.机器人自动回复好友。3.群助手功能（例如：查询垃圾分类、天气、日历、电影实时票房、快递物流、PM2.5等）
  ☆10,210Updated 4 years ago