Alternatives and similar repositories for crawlab:

Users that are interested in crawlab are comparing it to the libraries listed below

• Gerapy / Gerapy
  Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
  ☆3,424Updated 5 months ago
• my8100 / scrapydweb
  Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…
  ☆3,267Updated 2 months ago
• andeya / pholcus
  Pholcus is a distributed high-concurrency crawler software written in pure golang
  ☆7,588Updated 2 years ago
• GeneralNewsExtractor / GeneralNewsExtractor
  新闻网页正文通用抽取器 Beta 版.
  ☆3,716Updated 10 months ago
• lionsoul2014 / ip2region
  Ip2region (2.0 - xdb) is a offline IP address manager framework and locator, support billions of data segments, ten microsecond searching…
  ☆17,714Updated 4 months ago
• imWildCat / scylla
  Intelligent proxy pool for Humans™ to extract content from the internet and build your own Large Language Models in this new AI era
  ☆3,997Updated 2 months ago
• XiaoMi / soar
  SQL Optimizer And Rewriter
  ☆8,742Updated last year
• go-kratos / kratos
  Your ultimate Go microservices framework for the cloud-native era.
  ☆24,203Updated this week
• snail007 / goproxy
  🔥 Proxy is a high performance HTTP(S) proxies, SOCKS5 proxies,WEBSOCKET, TCP, UDP proxy server implemented by golang. Now, it supports …
  ☆16,248Updated 3 weeks ago
• DormyMo / SpiderKeeper
  admin ui for scrapy/open source scrapinghub
  ☆2,765Updated last year
• qishibo / AnotherRedisDesktopManager
  🚀🚀🚀A faster, better and more stable Redis desktop manager [GUI client], compatible with Linux, Windows, Mac.
  ☆32,119Updated last month
• jhao104 / proxy_pool
  Python ProxyPool for web spider
  ☆22,283Updated 2 months ago
• tophubs / TopList
  今日热榜，一个获取各大热门网站热门头条的聚合网站，使用Go语言编写，多协程异步快速抓取信息，预览//mo.fish
  ☆4,695Updated 2 years ago
• Python3WebSpider / ProxyPool
  An Efficient ProxyPool with Getter, Tester and Server
  ☆5,962Updated 9 months ago
• SpiderClub / haipproxy
  High available distributed ip proxy pool, powerd by Scrapy and Redis
  ☆5,472Updated 2 years ago
• labring / sealos
  Sealos is a production-ready Kubernetes distribution that makes deployment simple and efficient. Instantly set up development environment…
  ☆15,309Updated this week
• openimsdk / open-im-server
  IM Chat ChatGPT
  ☆14,593Updated last week
• ehang-io / nps
  一款轻量级、高性能、功能强大的内网穿透代理服务器。支持tcp、udp、socks5、http等几乎所有流量转发，可用来访问内网网站、本地支付接口调试、ssh访问、远程桌面，内网dns解析、内网socks5代理等等……，并带有功能强大的web管理端。a lightweight…
  ☆31,709Updated 10 months ago
• mindoc-org / mindoc
  Golang实现的基于beego框架的接口在线文档管理系统
  ☆7,526Updated last week
• baidu / amis
  前端低代码框架，通过 JSON 配置就能生成各种页面。
  ☆18,101Updated this week
• ssssssss-team / spider-flow
  新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。
  ☆9,924Updated last year
• gorse-io / gorse
  Gorse open source recommender system engine
  ☆8,896Updated this week
• chai2010 / advanced-go-programming-book
  《Go语言高级编程》开源图书，涵盖CGO、Go汇编语言、RPC实现、Protobuf插件实现、Web框架实现、分布式系统等高阶主题(完稿)
  ☆19,665Updated last month
• apache / skywalking
  APM, Application Performance Monitoring System
  ☆24,247Updated this week
• binux / pyspider
  A Powerful Spider(Web Crawler) System in Python.
  ☆16,582Updated 11 months ago
• scrapinghub / portia
  Visual scraping for Scrapy
  ☆9,395Updated 10 months ago
• avwo / whistle
  HTTP, HTTP2, HTTPS, Websocket debugging proxy
  ☆14,728Updated this week
• miyakogi / pyppeteer
  Headless chrome/chromium automation library (unofficial port of puppeteer)
  ☆3,573Updated 3 years ago
• Tencent / APIJSON
  🏆 实时 零代码、全功能、强安全 ORM 库 🚀 后端接口和文档零代码，前端(客户端) 定制返回 JSON 的数据和结构 🏆 Real-Time coding-free, powerful and secure ORM 🚀 providing APIs and D…
  ☆17,800Updated this week
• YMFE / yapi
  YApi 是一个可本地部署的、打通前后端及QA的、可视化的接口管理平台
  ☆27,568Updated 8 months ago