matuobasyouca/spider external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

matuobasyouca/spider

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/matuobasyouca/spider)

Close

matuobasyouca / spiderView on GitHubMore

• External links
• Readme badge

a simple distributed spider in Java. Java编写的一个简单分布式爬虫

☆160Jun 18, 2013Updated 13 years ago

Alternatives and similar repositories for spider

Users that are interested in spider are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• JFanZhao / spider

  View on GitHub
  使用java+httpclient+httpcleaner，多线程、分布式爬去电商网站商品信息，数据存储在hbase上，并使用solr对商品建立索引，使用redis队列存储一个共享的url仓库；使用zookeeper对爬虫节点生命周期进行监视等。
  ☆235Nov 6, 2020Updated 5 years ago
• thegodofwar / Spider

  View on GitHub
  利用HttpClient4+实现网络小说爬虫，可动态添加热门的小说网站
  ☆30Sep 6, 2012Updated 14 years ago
• yuki-lau / weibo-spider

  View on GitHub
  新浪微博爬虫，采用Java语言开发，基于HTTPClient 4.0，采用MySQL存储爬取数据，支持多进程并发执行。功能包括：爬取微博、评论、转发、关注列表（层次）。根据数据需求，持续更新...
  ☆354Feb 27, 2014Updated 12 years ago
• gsh199449 / DistributedCrawler

  View on GitHub
  DistributeCrawler的Maven版
  ☆10Jun 20, 2022Updated 4 years ago
• yinchuandong / DistributedCrawler

  View on GitHub
  java分布式爬虫，主机和从机控制的机制
  ☆14May 21, 2015Updated 11 years ago
• AI Agents on DigitalOcean Gradient AI Platform • Ad
  Build production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
• zqhxuyuan / zava

  View on GitHub
  java implementation framework from github
  ☆13Apr 8, 2015Updated 11 years ago
• sdcuike / dubbo-brave

  View on GitHub
  dubbo-brave集成
  ☆10Mar 16, 2016Updated 10 years ago
• wu560130911 / ChatColony

  View on GitHub
  分布式在线聊天系统
  ☆10Sep 17, 2014Updated 12 years ago
• caocf / distribute_framework

  View on GitHub
  分布式脚手架框架（总结整理）
  ☆15Aug 27, 2015Updated 11 years ago
• chenkai1100 / SpiderFrame

  View on GitHub
  分布式网络爬虫架构
  ☆16Sep 26, 2016Updated 10 years ago
• canghaiyisu666 / spider

  View on GitHub
  爬虫项目源码整理，使用redis进行url缓存，hbase进行详细信息的存储。使用zookeeper进行爬虫线程的状态监控。
  ☆17Oct 7, 2015Updated 10 years ago
• QuanZhong / ZKConfig

  View on GitHub
  ZkConfig是为zookeeper开发的配置服务工具包，能与现有的Java系统进行良好的集成，也可以使用与非java系统以独立进程运行。提供与spring进行集成的插件。采用注解方式对需要动态更新的内存数据对象进行标注。 ZkConfig用于解决在系统集群中配置文件的实…
  ☆26Apr 17, 2015Updated 11 years ago
• zyongjava / spider

  View on GitHub
  利用spring boot + webmagic 开发的java爬虫系统
  ☆60Dec 29, 2016Updated 9 years ago
• erliang20088 / TianLiangEmotionClassfy

  View on GitHub
  天亮中文情感分类器，基于vsm+天亮分词器+多影响因子动态调整开发，正向准确率81%，负向准确率74%
  ☆10Jun 20, 2022Updated 4 years ago
• Managed Kubernetes at scale on DigitalOcean • Ad
  DigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
• tzolov / springboot-ambari-service

  View on GitHub
  Toolkit that can bundle any Spring Boot application into an Apache Ambari Service, enabling Ambari to provision, manage and monitor the s…
  ☆13Oct 9, 2015Updated 10 years ago
• KKys / ZhiHuSpider

  View on GitHub
  Java无框架实现爬取知乎用户信息、图片和知乎推荐内容并下载到本地或数据库中
  ☆388Jan 21, 2017Updated 9 years ago
• menyouping / jw

  View on GitHub
  jw, short for java web, 模仿spring, 实现一个简单可用的java web框架
  ☆20Jun 20, 2022Updated 4 years ago
• qq254963746 / gecco

  View on GitHub
  易用的轻量化的网络爬虫(Easy to use lightweight web crawler)
  ☆10Mar 21, 2016Updated 10 years ago
• jinweile / spider

  View on GitHub
  定制爬虫工具（sqlserver版），通过正则表达式自定义抓取模版，通过自定义数据模型入库
  ☆10Sep 5, 2017Updated 9 years ago
• gsh199449 / spider

  View on GitHub
  A configurable web spider with a easy-to-use web console
  ☆998Jun 3, 2026Updated 3 months ago
• jintaodu / ProductReviewOpinionMining

  View on GitHub
  2013,05-2015,02 产品评论情感分析
  ☆15Jun 29, 2015Updated 11 years ago
• zongtui / zongtui-webcrawler

  View on GitHub
  基于hadoop思维的分布式网络爬虫。
  ☆85Mar 8, 2016Updated 10 years ago
• yangguang2014 / distributedCrawler

  View on GitHub
  华南理工大学高英实验室进行的分布式爬虫项目,除了实验室内部人员外,不得私自传播.
  ☆21Jul 13, 2014Updated 12 years ago
• Managed hosting for WordPress and PHP on Cloudways • Ad
  Managed hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
• CrawlScript / CrawlScript

  View on GitHub
  CrawlScript 基于JAVA的网络爬虫脚本语言，可以直接使用或用JAVA二次开发。
  ☆35Apr 4, 2014Updated 12 years ago
• fjfd / microscope

  View on GitHub
  大规模分布式系统的跟踪、监控、告警平台
  ☆55May 15, 2014Updated 12 years ago
• ushelp / EasyMonitor

  View on GitHub
  基于 Java 的免费开源跨平台系统运行监控服务应用及引擎框架。A free, open source, cross-platform system running monitoring service application and engine framework ba…
  ☆17Aug 13, 2019Updated 7 years ago
• qiuChengleiy / java-thread-all

  View on GitHub
  ⭐️⭐️⭐️java多线程系列教程(从入门到进阶+源码解读+面试题)https://www.qiuchenglei.top
  ☆16Sep 14, 2022Updated 4 years ago
• oldmanpushcart / excavator

  View on GitHub
  Excavator（挖掘机）是一个分布式的Java RMI框架。（求项目使用，有兴趣的可以电邮oldmanpushcart@gmail.com）
  ☆54Jun 29, 2022Updated 4 years ago
• xiaoyang611 / crawler-denfender

  View on GitHub
  反网页爬虫系统
  ☆39Mar 10, 2015Updated 11 years ago
• ningyu1 / fastdfs-client

  View on GitHub
  FastDfs-client是一个访问Fastdfs的Java客户端框架，帮助开发人员快速使用分布式文件系统的工具，封装了TrackerClient操作来管理存储节点，封装了StorageClient操作来执行文件上传下载功能。
  ☆15Jun 19, 2020Updated 6 years ago
• linyiqun / opinion-mining-system

  View on GitHub
  新闻评论观点挖掘系统，粗粒度的分析出新闻网评观点的倾向和走势
  ☆54Jun 1, 2015Updated 11 years ago
• CrawlScript / DataHref

  View on GitHub
  数据挖掘算法及工具教程
  ☆27Jun 5, 2016Updated 10 years ago
• Deploy to Railway using AI coding agents - Free Credits Offer • Ad
  Use Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
• subchen / jetbrick-webmvc

  View on GitHub
  jetbrick web mvc framework
  ☆26Jun 23, 2015Updated 11 years ago
• RockeyHoo / messenger

  View on GitHub
  rpc_learn Spring + Netty + Protostuff + ZooKeeper 实现了一个轻量级 RPC 框架，使用 Spring 提供依赖注入与参数配置，使用 Netty 实现 NIO 方式的数据传输，使用 Protostuff 实现对象序列化，使用 …
  ☆19May 26, 2015Updated 11 years ago
• jinshuai86 / Spider

  View on GitHub
  基于Java的多线程爬虫框架
  ☆11Jun 14, 2024Updated 2 years ago
• johnhany / WPCrawler

  View on GitHub
  a web crawler for single WordPress site
  ☆49Dec 12, 2013Updated 12 years ago
• yxlHuster / Sentiment

  View on GitHub
  情感分类
  ☆24Feb 23, 2014Updated 12 years ago
• ziapple / DBExchange

  View on GitHub
  基于ActiveMQ的数据交换中间件
  ☆14Aug 17, 2014Updated 12 years ago
• importsource / blockchain-samples-transaction

  View on GitHub
  ☆18Oct 11, 2021Updated 4 years ago