canghaiyisu666/spider external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

canghaiyisu666/spider

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/canghaiyisu666/spider)

Close

canghaiyisu666 / spiderView on GitHubMore

• External links
• Readme badge

爬虫项目源码整理，使用redis进行url缓存，hbase进行详细信息的存储。使用zookeeper进行爬虫线程的状态监控。

☆17Oct 7, 2015Updated 10 years ago

Alternatives and similar repositories for spider

Users that are interested in spider are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• duoan / codes-scratch-akka

  View on GitHub
  akka学习理解，使用了maven、sbt两种构建方式，同时使用量java和scala两种语言实现。akka入门，清晰理解akka流程
  ☆13Oct 18, 2015Updated 10 years ago
• yinchuandong / DistributedCrawler

  View on GitHub
  java分布式爬虫，主机和从机控制的机制
  ☆14May 21, 2015Updated 11 years ago
• ququzone / image-server

  View on GitHub
  image server base on nosql
  ☆10Aug 24, 2016Updated 9 years ago
• pecker / kony-converter

  View on GitHub
  基于openoffice+jodconverter-core-3.0-beta-4-dist+spring+quartz+dubbo+zookeeper+MyBatis服务化的文档转换服务
  ☆13Jul 21, 2016Updated 10 years ago
• hfbin / ThreadSocket

  View on GitHub
  🚜线程安全、网络编程、消息中间件文章源码🚜
  ☆28Apr 19, 2018Updated 8 years ago
• End-to-end encrypted cloud storage - Proton Drive • Ad
  Special offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
• pecker / kony-encorder

  View on GitHub
  基于ffmpeg+spring+quartz+dubbo+zookeeper+MyBatis服务化的视频转换分布式服务
  ☆12Jul 21, 2016Updated 10 years ago
• sunnotes / Ali-Data-Mining

  View on GitHub
  阿里巴巴大数据竞赛
  ☆63Jun 2, 2014Updated 12 years ago
• wangxuehui / rpc

  View on GitHub
  a simple rpc framework for java
  ☆14Dec 9, 2014Updated 11 years ago
• Glacier759 / Get_58_Data

  View on GitHub
  利用WebMagic框架进行58同城数据的抓取
  ☆12Oct 13, 2014Updated 11 years ago
• chenzhenyang / aquila

  View on GitHub
  迁移工具，目标是Oracle，MySQL，SqlServer到PostgreSQL的单项迁移，PostgreSQL和大数据平台Hive，Hbase，Impala等的双向迁移。
  ☆10Dec 3, 2014Updated 11 years ago
• JoneXiong / MoleSys

  View on GitHub
  基于Mole的一个企业级web应用的架子
  ☆24Jan 30, 2015Updated 11 years ago
• xuminwlt / j360-redis-async-db

  View on GitHub
  j360系列 - 缓存异步写数据库的框架
  ☆15Apr 14, 2016Updated 10 years ago
• supermy / flume-kafka-storm

  View on GitHub
  大数据实时计算的基础框架
  ☆48Jan 12, 2015Updated 11 years ago
• RockeyHoo / messenger

  View on GitHub
  rpc_learn Spring + Netty + Protostuff + ZooKeeper 实现了一个轻量级 RPC 框架，使用 Spring 提供依赖注入与参数配置，使用 Netty 实现 NIO 方式的数据传输，使用 Protostuff 实现对象序列化，使用 …
  ☆19May 26, 2015Updated 11 years ago
• Deploy to Railway using AI coding agents - Free Credits Offer • Ad
  Use Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
• weibocom / prism

  View on GitHub
  实时数据分析平台
  ☆41Jun 26, 2013Updated 13 years ago
• 2397459813 / convert2pdf

  View on GitHub
  word,excel转pdf
  ☆11Oct 26, 2018Updated 7 years ago
• Hanmourang / Pinot

  View on GitHub
  Pinot 是一个实时分布式的 OLAP 数据存储和分析系统。LinkedIn 使用它实现低延迟可伸缩的实时分析。Pinot 从离线数据源（包括 Hadoop 和各类文件）和在线数据源（如 Kafka）中攫取数据进行分析。Pinot 被设计是可以进行水平扩展的
  ☆16Nov 8, 2015Updated 10 years ago
• zhongxunking / sync

  View on GitHub
  Sync是一款分布式场景下基于Redis的安全高效的线程同步组件，提供分布式可重入互斥锁、分布式可重入读写锁、分布式信号量。提供相应注解，使用简单，可与spring-boot无缝集成。
  ☆13Oct 8, 2022Updated 3 years ago
• gloriawish / mom

  View on GitHub
  参加阿里巴巴中间件比赛时的mom项目源码
  ☆22Nov 12, 2015Updated 10 years ago
• meway24 / douyin-assistant

  View on GitHub
  douyin api,抖音上传接口,抖音接口，抖音搬家，视频备份
  ☆19Aug 9, 2020Updated 6 years ago
• jiayuasu / JTSplus

  View on GitHub
  JTS Topology Suite 1.14 with additional functions for GeoSpark
  ☆14Jan 5, 2018Updated 8 years ago
• laoxingtalk / dubbo-switch

  View on GitHub
  基于阿里Dubbo框架的服务切换工具
  ☆19Jul 21, 2017Updated 9 years ago
• feimumoke / dipper

  View on GitHub
  基于grpc开发的跨语言的交互系统，集成B/C/S，Brower基于SpringBoot2开发，使用Netty+WebSocket实现QQ功能，Client基于PyQt5，实现用户管理和博客管理。图片服务和博客服务基于Go语言开发，并且提供了HTTP的图片服务功能。
  ☆14Apr 14, 2021Updated 5 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• junjiemars / nore

  View on GitHub
  No More than a C build system for clang, gcc and msvc
  ☆13Mar 20, 2025Updated last year
• sdksdk0 / inote

  View on GitHub
  云笔记项目，大数据项目，Hbase+Redis+Hadoop+Zookeeper
  ☆14May 2, 2018Updated 8 years ago
• eguid / livePushServer

  View on GitHub
  一个基于redis消息队列的livePush推流器的分布式服务，修改部分livePush推流实现，采用监听redis消息队列方式控制推流和停止
  ☆11Sep 22, 2016Updated 9 years ago
• oldmanpushcart / excavator

  View on GitHub
  Excavator（挖掘机）是一个分布式的Java RMI框架。（求项目使用，有兴趣的可以电邮oldmanpushcart@gmail.com）
  ☆52Jun 29, 2022Updated 4 years ago
• martin-1992 / Netty-Notes

  View on GitHub
  Netty 源码分析，包含各种流程图
  ☆11Jun 23, 2020Updated 6 years ago
• ddviplinux / crawler-framework

  View on GitHub
  分布式爬虫框架,基于webdrvier模拟用户请求,kafka消息传递,分布式网页存储使用hbase,task异步任务多线程解析,提供基础服务如:proxy ip服务和号码验证服务等, proxy page使用H5和we版进行接入
  ☆13Dec 18, 2015Updated 10 years ago
• ahuan9527 / xuewuyou

  View on GitHub
  开源项目，供学习
  ☆10May 7, 2021Updated 5 years ago
• allwefantasy / godear

  View on GitHub
  ServiceFramework 示例项目
  ☆10Apr 2, 2016Updated 10 years ago
• Mr-LuXiaoHua / dohko-state-machine

  View on GitHub
  简单状态机实现。同时以简化的订单状态机为例子进行了说明。
  ☆16Oct 13, 2020Updated 5 years ago
• Serverless GPU API endpoints on Runpod - Get Bonus Credits • Ad
  Skip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
• tbwork / alipay_edit_typer

  View on GitHub
  Just a DEMO to demonstrate how to use JNA to type chars into alipay's password edit control automatically.
  ☆12Dec 21, 2017Updated 8 years ago
• hqfeijian / runlife_api

  View on GitHub
  区块链+计步运动项目，主要采用以太坊、智能合约、springboot以及小程序等技术
  ☆56Jul 26, 2018Updated 8 years ago
• jgchen / zookeeper-recipes

  View on GitHub
  zookeeper官方提供的分布式锁，选举master，和分布式队列实现
  ☆16Mar 11, 2014Updated 12 years ago
• newpanjing / flow-chart

  View on GitHub
  js在线流程图 javascript online flow chart
  ☆24Mar 11, 2019Updated 7 years ago
• guoyu511 / vertx-spring

  View on GitHub
  Integration of vertx-web & spring framework
  ☆17Oct 18, 2017Updated 8 years ago
• ScienJus / spring-disque

  View on GitHub
  基于 Spring 和 Jedis 的 Disque 封装，使用注解驱动
  ☆22Feb 15, 2016Updated 10 years ago
• lw309637554 / alicloud-hbase-spark-examples

  View on GitHub
  ☆29Aug 2, 2018Updated 8 years ago