matuobasyouca/spider external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

matuobasyouca/spider

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/matuobasyouca/spider)

Close

matuobasyouca / spiderView on GitHubMore

• External links
• Readme badge

a simple distributed spider in Java. Java编写的一个简单分布式爬虫

☆160Jun 18, 2013Updated 12 years ago

Alternatives and similar repositories for spider

Users that are interested in spider are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• JFanZhao / spider

  View on GitHub
  使用java+httpclient+httpcleaner，多线程、分布式爬去电商网站商品信息，数据存储在hbase上，并使用solr对商品建立索引，使用redis队列存储一个共享的url仓库；使用zookeeper对爬虫节点生命周期进行监视等。
  ☆236Nov 6, 2020Updated 5 years ago
• yuki-lau / weibo-spider

  View on GitHub
  新浪微博爬虫，采用Java语言开发，基于HTTPClient 4.0，采用MySQL存储爬取数据，支持多进程并发执行。功能包括：爬取微博、评论、转发、关注列表（层次）。根据数据需求，持续更新...
  ☆357Feb 27, 2014Updated 12 years ago
• thegodofwar / Spider

  View on GitHub
  利用HttpClient4+实现网络小说爬虫，可动态添加热门的小说网站
  ☆30Sep 6, 2012Updated 13 years ago
• gsh199449 / DistributedCrawler

  View on GitHub
  DistributeCrawler的Maven版
  ☆10Jun 20, 2022Updated 3 years ago
• yinchuandong / DistributedCrawler

  View on GitHub
  java分布式爬虫，主机和从机控制的机制
  ☆14May 21, 2015Updated 11 years ago
• End-to-end encrypted cloud storage - Proton Drive • Ad
  Special offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
• zqhxuyuan / zava

  View on GitHub
  java implementation framework from github
  ☆13Apr 8, 2015Updated 11 years ago
• sdcuike / dubbo-brave

  View on GitHub
  dubbo-brave集成
  ☆10Mar 16, 2016Updated 10 years ago
• wu560130911 / ChatColony

  View on GitHub
  分布式在线聊天系统
  ☆10Sep 17, 2014Updated 11 years ago
• caocf / distribute_framework

  View on GitHub
  分布式脚手架框架（总结整理）
  ☆15Aug 27, 2015Updated 10 years ago
• chenkai1100 / SpiderFrame

  View on GitHub
  分布式网络爬虫架构
  ☆16Sep 26, 2016Updated 9 years ago
• QuanZhong / ZKConfig

  View on GitHub
  ZkConfig是为zookeeper开发的配置服务工具包，能与现有的Java系统进行良好的集成，也可以使用与非java系统以独立进程运行。提供与spring进行集成的插件。采用注解方式对需要动态更新的内存数据对象进行标注。 ZkConfig用于解决在系统集群中配置文件的实…
  ☆25Apr 17, 2015Updated 11 years ago
• shenbaise / goodcrawler

  View on GitHub
  网络爬虫
  ☆50Mar 18, 2014Updated 12 years ago
• canghaiyisu666 / spider

  View on GitHub
  爬虫项目源码整理，使用redis进行url缓存，hbase进行详细信息的存储。使用zookeeper进行爬虫线程的状态监控。
  ☆19Oct 7, 2015Updated 10 years ago
• zyongjava / spider

  View on GitHub
  利用spring boot + webmagic 开发的java爬虫系统
  ☆61Dec 29, 2016Updated 9 years ago
• GPUs on demand by Runpod - Special Offer Available • Ad
  Run AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
• tzolov / springboot-ambari-service

  View on GitHub
  Toolkit that can bundle any Spring Boot application into an Apache Ambari Service, enabling Ambari to provision, manage and monitor the s…
  ☆13Oct 9, 2015Updated 10 years ago
• subchen / jetbrick-webmvc

  View on GitHub
  jetbrick web mvc framework
  ☆26Jun 23, 2015Updated 10 years ago
• KKys / ZhiHuSpider

  View on GitHub
  Java无框架实现爬取知乎用户信息、图片和知乎推荐内容并下载到本地或数据库中
  ☆390Jan 21, 2017Updated 9 years ago
• gsh199449 / spider

  View on GitHub
  A configurable web spider with a easy-to-use web console
  ☆998Aug 21, 2018Updated 7 years ago
• menyouping / jw

  View on GitHub
  jw, short for java web, 模仿spring, 实现一个简单可用的java web框架
  ☆20Jun 20, 2022Updated 3 years ago
• suninformation / ymateplatform

  View on GitHub
  YMP开发框架是一套轻量级的JAVA应用开发框架，具有统一的配置体系结构、系统与业务日志分离、插件化开发模式、简单轻量的MVC和持久化支持等特性；
  ☆33Apr 19, 2018Updated 8 years ago
• CrawlScript / CrawlScript

  View on GitHub
  CrawlScript 基于JAVA的网络爬虫脚本语言，可以直接使用或用JAVA二次开发。
  ☆35Apr 4, 2014Updated 12 years ago
• fjfd / microscope

  View on GitHub
  大规模分布式系统的跟踪、监控、告警平台
  ☆55May 15, 2014Updated 12 years ago
• oldmanpushcart / excavator

  View on GitHub
  Excavator（挖掘机）是一个分布式的Java RMI框架。（求项目使用，有兴趣的可以电邮oldmanpushcart@gmail.com）
  ☆51Jun 29, 2022Updated 3 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• ningyu1 / fastdfs-client

  View on GitHub
  FastDfs-client是一个访问Fastdfs的Java客户端框架，帮助开发人员快速使用分布式文件系统的工具，封装了TrackerClient操作来管理存储节点，封装了StorageClient操作来执行文件上传下载功能。
  ☆15Jun 19, 2020Updated 5 years ago
• CrawlScript / DataHref

  View on GitHub
  数据挖掘算法及工具教程
  ☆27Jun 5, 2016Updated 9 years ago
• linyiqun / opinion-mining-system

  View on GitHub
  新闻评论观点挖掘系统，粗粒度的分析出新闻网评观点的倾向和走势
  ☆53Jun 1, 2015Updated 10 years ago
• AichaelLee / springboot-activiti

  View on GitHub
  最近的项目中需要使用到activit工作流，但是找到的资料不多，所以在activiti-app的基础上，根据自己的需求开发前后端分离的工作流平台，使用技术vue+springboot，目前正在进行中
  ☆17Dec 19, 2018Updated 7 years ago
• RockeyHoo / messenger

  View on GitHub
  rpc_learn Spring + Netty + Protostuff + ZooKeeper 实现了一个轻量级 RPC 框架，使用 Spring 提供依赖注入与参数配置，使用 Netty 实现 NIO 方式的数据传输，使用 Protostuff 实现对象序列化，使用 …
  ☆19May 26, 2015Updated 11 years ago
• jinshuai86 / Spider

  View on GitHub
  基于Java的多线程爬虫框架
  ☆11Jun 14, 2024Updated last year
• johnhany / WPCrawler

  View on GitHub
  a web crawler for single WordPress site
  ☆49Dec 12, 2013Updated 12 years ago
• yxlHuster / Sentiment

  View on GitHub
  情感分类
  ☆24Feb 23, 2014Updated 12 years ago
• ziapple / DBExchange

  View on GitHub
  基于ActiveMQ的数据交换中间件
  ☆14Aug 17, 2014Updated 11 years ago
• Simple, predictable pricing with DigitalOcean hosting • Ad
  Always know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
• deanjin / houseHunter

  View on GitHub
  杭州房地产观察者
  ☆12Jan 25, 2017Updated 9 years ago
• RobertFischer / tomcat8-redis-sessions

  View on GitHub
  Library for using Redis sessions in Tomcat 8.
  ☆15Jul 17, 2015Updated 10 years ago
• JiaoPaner / WeiboSpider

  View on GitHub
  一个基于微博用户数据的Java爬虫项目
  ☆319Aug 18, 2020Updated 5 years ago
• ysc / rank

  View on GitHub
  rank是一个seo工具，用于分析网站的搜索引擎收录排名。
  ☆65May 15, 2017Updated 9 years ago
• naivor / CheckStyle

  View on GitHub
  在协同开发中让代码风格保持一致
  ☆26Jun 6, 2017Updated 8 years ago
• Glacier759 / Get_58_Data

  View on GitHub
  利用WebMagic框架进行58同城数据的抓取
  ☆12Oct 13, 2014Updated 11 years ago
• NetEase / spark-alarm

  View on GitHub
  Alerting and monitoring tool for Apache Spark
  ☆23May 20, 2022Updated 4 years ago