zjucx/DistributedCrawler external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

zjucx/DistributedCrawler

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/zjucx/DistributedCrawler)

Close

zjucx / DistributedCrawlerView on GitHubMore

• External links
• Readme badge

分布式爬虫，redis缓存，mysql持久化，rpc实现分布式。可用docker部署

☆47Aug 12, 2017Updated 8 years ago

Alternatives and similar repositories for DistributedCrawler

Users that are interested in DistributedCrawler are comparing it to the libraries listed below

• zjucx / SearchEngine

  View on GitHub
  web部分（vuejs＋beego框架＋webpack组件化）；爬虫部分（1680位明星的sina微博首页收据）；分词部分（结巴分词）；索引构建部分（快拍+败者树）；索引搜索部分（倒排索引R+tree）
  ☆72Sep 1, 2017Updated 8 years ago
• ethreads / ImByGo

  View on GitHub
  一个基于melody+gin+goredis+gorm的websocket聊天架构，利用redis实现支持分布式部署
  ☆24Sep 5, 2018Updated 7 years ago
• lycying / rstore

  View on GitHub
  rstore是一个使用golang实现的快速、轻量级的数据库中间件，使用redis协议交互，根据路由规则，某类key可同时存放在mysql，postgresql，redis中。自带web管理工具
  ☆25Mar 8, 2017Updated 8 years ago
• suburbancrac / tio

  View on GitHub
  a tiny iothub, simple and useful. 轻量的 iothub，用经典的物模型简化 iot 应用开发 device-shadow, iot, iothub, job, lightweight, mqtt, mysql, shadow, sqlit…
  ☆32May 16, 2025Updated 9 months ago
• shunde / QRCode-Auth

  View on GitHub
  模拟微信扫码登录
  ☆18Mar 1, 2016Updated 9 years ago
• gqcn / dister

  View on GitHub
  dister(Distribution Cluster)是一款轻量级高性能的分布式集群管理软件，实现了分布式软件架构中的常用核心组件，包括：服务配置管理中心、服务注册与发现、服务健康检查、服务负载均衡。dister的灵感来源于ZooKeeper、Consul、Etcd，它们…
  ☆42Mar 8, 2018Updated 7 years ago
• Forec / port-scanner

  View on GitHub
  Port Scanner （端口扫描工具，分别用C++/Python/Golang编写）
  ☆10Oct 7, 2016Updated 9 years ago
• pingguoxueyuan / school_suggestion

  View on GitHub
  school_suggestion
  ☆11Feb 21, 2018Updated 8 years ago
• varconf / varconf-server

  View on GitHub
  varconf配置中心后端代码（varconf是基于golang的分布式统一配置中心，轻量级部署和接入）
  ☆13Apr 8, 2020Updated 5 years ago
• menghuan / goDistributedCron

  View on GitHub
  一个简单的分布式任务调度系统，有vue管理后台可以操作
  ☆25Aug 12, 2019Updated 6 years ago
• masixun71 / swoft-zipkin

  View on GitHub
  swoft zipkin sdk
  ☆14Oct 16, 2018Updated 7 years ago
• donnie4w / timgo

  View on GitHub
  tim client in go
  ☆12Feb 28, 2025Updated last year
• GoBelieveIO / conference

  View on GitHub
  group video chat
  ☆12Nov 17, 2021Updated 4 years ago
• smtc / godat

  View on GitHub
  double array trie algorithm golang
  ☆18Oct 28, 2014Updated 11 years ago
• xuanyanwow / GoFrameNotifyConsumer

  View on GitHub
  类似微信支付回调，业务数据回调推送给客户，直到超出次数限制或者推送成功。
  ☆12Mar 10, 2020Updated 5 years ago
• zhaojwaln / beego-FaceRecognition

  View on GitHub
  基于beego框架的人脸识别系统
  ☆11Dec 19, 2017Updated 8 years ago
• aiganbao / go-swagger

  View on GitHub
  go实现的企业级swagger文档管理中心
  ☆11Mar 16, 2018Updated 7 years ago
• xtaci / fibernet

  View on GitHub
  Message Queue/C++/Lua based game server
  ☆15May 3, 2013Updated 12 years ago
• micro-plat / fsync

  View on GitHub
  文件同步服务器，包括发送端，接收端。同一发送端支持多个接收端
  ☆13May 23, 2019Updated 6 years ago
• yunpractice / redis_server

  View on GitHub
  golang版redis服务器实现
  ☆10Feb 16, 2019Updated 7 years ago
• DoloresTeam / dolores-admin

  View on GitHub
  dolores 后台管理网站
  ☆16Jul 28, 2017Updated 8 years ago
• zanjs / taizhou-fe-api

  View on GitHub
  💥💥 仿今日头条后端 API 服务 Golang ，后台管理, APP 服务, Vue、 ReactJS、台湾头条
  ☆52Mar 30, 2018Updated 7 years ago
• ops-itop / cmdbApi

  View on GitHub
  itop cmdb API
  ☆14Apr 19, 2023Updated 2 years ago
• chenenkou / sphinx-for-chinese

  View on GitHub
  sphinx-for-chinese是一款专注于中文搜索的全文检索软件，在sphinx的基础上添加了中文处理模块并优化了中文搜索效果
  ☆13Jun 29, 2017Updated 8 years ago
• xuezhaojun / udmey-coding-interview-question-golang-solutions

  View on GitHub
  Udmey面试问题golang解法
  ☆11Jun 14, 2019Updated 6 years ago
• btracey / mixent

  View on GitHub
  Package for estimating the entropy of a mixture distribution
  ☆15Oct 28, 2017Updated 8 years ago
• foreversmart / distributed-task

  View on GitHub
  用go语言编写的分布式任务调度框架. A framework of task execution in distributed system Written with go
  ☆28Jan 27, 2015Updated 11 years ago
• hb-chen / gmqtt

  View on GitHub
  Golang MQTT Broker.
  ☆84Feb 25, 2023Updated 3 years ago
• philpearl / graphblog

  View on GitHub
  Code to support a blog post about optimising some graph stuff
  ☆16Nov 10, 2018Updated 7 years ago
• go-ego / re

  View on GitHub
  Re is a tool for helping develop with ego app framework.
  ☆13Jul 29, 2018Updated 7 years ago
• asppj / lolita

  View on GitHub
  基于gin 微服务opentrace集成
  ☆14Mar 16, 2023Updated 2 years ago
• bjdgyc / godaemonize

  View on GitHub
  Command line utility to run a program as a Unix daemon 代替nohup的高级程序
  ☆16Aug 7, 2018Updated 7 years ago
• zjucx / myblog

  View on GitHub
  前端部分使用vue2.0-vuex-webpack-md编辑器，后端使用golang的beego框架的个人博客网站。代码中实际分为2个工程，beego和vue工程。部署将webpack打包后文件放在beego工程中。前后端路由分离。
  ☆31Jan 30, 2017Updated 9 years ago
• fuzziqersoftware / redis-shatter

  View on GitHub
  Redis sharding proxy
  ☆17Dec 20, 2020Updated 5 years ago
• yinchuandong / DistributedCrawler

  View on GitHub
  java分布式爬虫，主机和从机控制的机制
  ☆14May 21, 2015Updated 10 years ago
• zjucx / RosePrisma

  View on GitHub
  使用深度学习算法将玫瑰花图片内容和另一幅图片的风格融合在一起
  ☆32Feb 14, 2017Updated 9 years ago
• simplejia / op

  View on GitHub
  通用op（后台运营）系统，后台开发工程师打造的针对后台服务的通用配置管理系统，带web操作界面
  ☆41Nov 17, 2018Updated 7 years ago
• iarjunsk / go_url_shortener

  View on GitHub
  Shortify - URL Shortner in go
  ☆19Apr 4, 2020Updated 5 years ago
• picone / SearchEngine

  View on GitHub
  使用go实现的简单搜索引擎
  ☆17Oct 17, 2017Updated 8 years ago