java分布式爬虫,主机和从机控制的机制
☆14May 21, 2015Updated 10 years ago
Alternatives and similar repositories for DistributedCrawler
Users that are interested in DistributedCrawler are comparing it to the libraries listed below
Sorting:
- DistributeCrawler的Maven版☆10Jun 20, 2022Updated 3 years ago
- 华南理工大学高英实验室进行的分布式爬虫项目,除了实验室内部人员外,不得私自传播.☆21Jul 13, 2014Updated 11 years ago
- java implementation framework from github☆13Apr 8, 2015Updated 10 years ago
- JVM虚拟DNS,开发期间可以省去hosts文件配置☆37Oct 8, 2022Updated 3 years ago
- 爬虫项目源码整理,使用redis进行url缓存,hbase进行详细信息的存储。使用zookeeper进行爬虫线程的状态监控。☆19Oct 7, 2015Updated 10 years ago
- Library for using Redis sessions in Tomcat 8.☆15Jul 17, 2015Updated 10 years ago
- 单文件Http工具类,支持GET,POST,断点续传,多线程断点续传☆11Sep 1, 2016Updated 9 years ago
- qq加群机器人,根据配置的关键词来搜索群并自动发送加群验证。难点:list滚动需要跨进程模拟触屏事件。使用前提:需要获取root权限,如需要获取更多机型的支持,需要添加相应机型的模拟触屏实现类。本项目不再维护,只提供给个人开发者学习使用。☆16Jul 23, 2018Updated 7 years ago
- 分布式网络爬虫架构☆16Sep 26, 2016Updated 9 years ago
- a simple rpc framework for java☆14Dec 9, 2014Updated 11 years ago
- springboot-dubbo-apigateway☆18Dec 2, 2016Updated 9 years ago
- 基于ffmpeg+spring+quartz+dubbo+zookeeper+MyBatis服务化的视频转换分布式服务☆12Jul 21, 2016Updated 9 years ago
- 此工程不更新了,请移步到最新的工程 https://github.com/xiangxik/castle-platform ,Based on servlet3.1, the realization of modular expansion of the java deve…☆24Nov 8, 2016Updated 9 years ago
- java implementation of NMEA 0183 coder/decoder, along with transportation support☆20Mar 2, 2018Updated 8 years ago
- Using Spring Cloud to develop microservices and deploy to Kubernetes☆22Jul 1, 2018Updated 7 years ago
- 基于Openresty整合lua server framework☆10Oct 20, 2017Updated 8 years ago
- 大型分布式系统实时监控平台☆28Jan 12, 2023Updated 3 years ago
- 基于Bytebuddy的Java Agent AOP框架☆11Feb 21, 2024Updated 2 years ago
- 网络游戏服务器通信框架☆13Apr 29, 2020Updated 5 years ago
- 使用openresty结合lua开发dubbo restful网关☆11Nov 5, 2018Updated 7 years ago
- Spring内存马检测和隐形马研究☆14Nov 28, 2021Updated 4 years ago
- spring-boot-start-dubbo☆26Oct 17, 2017Updated 8 years ago
- word,excel转pdf☆11Oct 26, 2018Updated 7 years ago
- 基于Netty、JSON-RPC的分布式弱联网游戏服务端☆34May 3, 2017Updated 8 years ago
- jstorm开发demo,小例子☆23Jul 18, 2015Updated 10 years ago
- golang版redis服务器实现☆10Feb 16, 2019Updated 7 years ago
- 我经常用到的一些小工具类:类型验证、转换,http,oauth,job,redis queue,jsonrpc等☆13Feb 8, 2017Updated 9 years ago
- spider使用java语言开发,使用Spring作为IoC容器,采用TCP/IP协议,在此基础上,结合SaaS金融交易系统的特性进行针对性和重点设计,以更加灵活和高效的满足金融交易系统多租户、高可用、分布式部署的要求。 spider默认采用JSON作为序列化机制,后续版本…☆10Sep 11, 2018Updated 7 years ago
- 参加阿里巴巴中间件比赛时的mom项目源码☆22Nov 12, 2015Updated 10 years ago
- maat是一个分布式事务中间件,实现了基于可靠消息的最终一致性事务控制.其可靠消息服务通过独立消息服务方案实现,与业务系统耦合低,目前支持的MQ有RocketMQ☆12Dec 6, 2018Updated 7 years ago
- ZxFrame为JAVA框架-支持读写分离,读数据源熔断,分库分表;多级缓存,防缓存击穿/穿透/雪崩;支持分布式ID/锁;配置热更新等☆13Jun 21, 2022Updated 3 years ago
- HiMagpie 网关,负责 TCP 长连接建立、心跳、消费消息队列并推送等。☆16Jun 1, 2017Updated 8 years ago
- springcloud微服务体系的java客户端生成方案☆10Sep 7, 2020Updated 5 years ago
- A project to support WebRTC for react-native-web☆13Nov 5, 2017Updated 8 years ago
- Autoproxy automatically detects proxies and stores them in the respective environment variables (e.g. http_proxy).☆13Oct 2, 2016Updated 9 years ago
- Spawns a reverse TCP shell on the machine its run on☆15Mar 29, 2014Updated 11 years ago
- Web/FileSystem Crawler Library☆36Updated this week
- 微信短视频后端☆14Oct 11, 2023Updated 2 years ago
- 基于Map/Reduce爬虫,可抽取各大新闻网站的新闻正文并进行分类和聚类☆74Jan 5, 2014Updated 12 years ago