yuki-lau/weibo-spider external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

yuki-lau/weibo-spider

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/yuki-lau/weibo-spider)

Close

yuki-lau / weibo-spiderView on GitHubMore

• External links
• Readme badge

新浪微博爬虫，采用Java语言开发，基于HTTPClient 4.0，采用MySQL存储爬取数据，支持多进程并发执行。功能包括：爬取微博、评论、转发、关注列表（层次）。根据数据需求，持续更新...

☆354Feb 27, 2014Updated 12 years ago

Alternatives and similar repositories for weibo-spider

Users that are interested in weibo-spider are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• matuobasyouca / spider

  View on GitHub
  a simple distributed spider in Java. Java编写的一个简单分布式爬虫
  ☆160Jun 18, 2013Updated 13 years ago
• JFanZhao / spider

  View on GitHub
  使用java+httpclient+httpcleaner，多线程、分布式爬去电商网站商品信息，数据存储在hbase上，并使用solr对商品建立索引，使用redis队列存储一个共享的url仓库；使用zookeeper对爬虫节点生命周期进行监视等。
  ☆236Nov 6, 2020Updated 5 years ago
• JiaoPaner / WeiboSpider

  View on GitHub
  一个基于微博用户数据的Java爬虫项目
  ☆318Aug 18, 2020Updated 5 years ago
• fullstackyang / weibo-crawler

  View on GitHub
  新型的免登录微博爬虫，自动获取Cookie直接进行抓取和解析微博数据，免去了账号登录的过程，彻底摆脱账号被封的困扰
  ☆37Oct 15, 2017Updated 8 years ago
• KKys / ZhiHuSpider

  View on GitHub
  Java无框架实现爬取知乎用户信息、图片和知乎推荐内容并下载到本地或数据库中
  ☆388Jan 21, 2017Updated 9 years ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• wycm / zhihu-crawler

  View on GitHub
  zhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目
  ☆919Apr 2, 2019Updated 7 years ago
• xiaoyang611 / crawler-denfender

  View on GitHub
  反网页爬虫系统
  ☆39Mar 10, 2015Updated 11 years ago
• liuzheng / weibo

  View on GitHub
  新浪weibo微博抓取，Python3 support
  ☆76Feb 20, 2017Updated 9 years ago
• shenbaise / goodcrawler

  View on GitHub
  网络爬虫
  ☆50Mar 18, 2014Updated 12 years ago
• QiuMing / zhihuWebSpider

  View on GitHub
  知乎爬虫，基于webmagic框架 .A java web spider base on webmagic.
  ☆69May 26, 2016Updated 10 years ago
• advanced-programs / weibo-service

  View on GitHub
  微博数据分析服务框架。
  ☆12Nov 10, 2015Updated 10 years ago
• qiyaTech / javaCrawling

  View on GitHub
  "奇伢爬虫"是基于sprint boot 、 WebMagic 实现 微信公众号文章、新闻、csdn、info等网站文章爬取，可以动态设置文章爬取规则、清洗规则，基本实现了爬取大部分网站的文章。
  ☆323Sep 3, 2017Updated 8 years ago
• yinchuandong / DistributedCrawler

  View on GitHub
  java分布式爬虫，主机和从机控制的机制
  ☆14May 21, 2015Updated 11 years ago
• CrawlScript / WebCollector

  View on GitHub
  WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup …
  ☆3,085Feb 10, 2026Updated 5 months ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• BluesTroy / seckill

  View on GitHub
  商品秒杀系统——Java并发实战和并发优化
  ☆12Oct 6, 2016Updated 9 years ago
• canghaiyisu666 / spider

  View on GitHub
  爬虫项目源码整理，使用redis进行url缓存，hbase进行详细信息的存储。使用zookeeper进行爬虫线程的状态监控。
  ☆17Oct 7, 2015Updated 10 years ago
• hemin1003 / java-spider

  View on GitHub
  一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集成功能）等资讯内容，配合elasticsearch框架用法，实现了自动爬虫，已投入线上生产使用。
  ☆339Nov 16, 2022Updated 3 years ago
• zoopaper / design-pattern

  View on GitHub
  设计模式
  ☆10Jun 13, 2023Updated 3 years ago
• zhegexiaohuozi / SeimiCrawler

  View on GitHub
  一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.
  ☆1,991Jun 24, 2026Updated last month
• yangwx1402 / wb_wx_zh_tt

  View on GitHub
  新浪微博，微信，知乎，头条爬虫，支持新浪登录打码获取cookie实现登录
  ☆16Jul 3, 2017Updated 9 years ago
• zongtui / zongtui-webcrawler

  View on GitHub
  基于hadoop思维的分布式网络爬虫。
  ☆85Mar 8, 2016Updated 10 years ago
• HYmnToLoki / ZhiHuDownLoad

  View on GitHub
  java爬取知乎上所有用户的头像和姓名信息
  ☆14Aug 16, 2015Updated 10 years ago
• code4craft / webmagic

  View on GitHub
  A scalable web crawler framework for Java.
  ☆11,683Dec 20, 2025Updated 7 months ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• MatrixSeven / ZhihuSpider

  View on GitHub
  知乎爬虫/可以爬出关注关系的爬虫
  ☆306Jun 7, 2025Updated last year
• jxqlovejava / PopularBlogSites

  View on GitHub
  个人收集的觉得不错的技术站点或技术博客
  ☆219Feb 1, 2018Updated 8 years ago
• adealjason / dtsopensource

  View on GitHub
  基于二阶提交理论实现的分布式事务服务框架
  ☆26Dec 24, 2016Updated 9 years ago
• xtuhcy / gecco

  View on GitHub
  Easy to use lightweight web crawler（易用的轻量化网络爬虫）
  ☆2,511Jan 23, 2026Updated 6 months ago
• gsh199449 / DistributeCrawler

  View on GitHub
  基于Map/Reduce爬虫,可抽取各大新闻网站的新闻正文并进行分类和聚类
  ☆73Jan 5, 2014Updated 12 years ago
• decaywood / XueQiuSuperSpider

  View on GitHub
  雪球股票信息超级爬虫
  ☆2,422Mar 27, 2024Updated 2 years ago
• LiuXingMing / SinaSpider

  View on GitHub
  新浪微博爬虫（Scrapy、Redis）
  ☆3,286Sep 5, 2018Updated 7 years ago
• gsh199449 / spider

  View on GitHub
  A configurable web spider with a easy-to-use web console
  ☆999Jun 3, 2026Updated last month
• wangshunping / weibo_spider

  View on GitHub
  graduate project, a weibo spider to find some interesting information such as "In social network , people tend to be happy or sad."
  ☆272Apr 10, 2016Updated 10 years ago
• Managed Database hosting by DigitalOcean • Ad
  PostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
• wo4li2wang / MSpider

  View on GitHub
  基于词频密度过滤、利用百度、谷歌、搜搜、360搜索4个引擎为种子来源的多线程爬虫，结果存入mysql。
  ☆98Mar 27, 2014Updated 12 years ago
• chengbinbbs / spider

  View on GitHub
  基于SSM的爬虫系统，Spring+Spring MVC+MyBatis+Druid+Redis+MQ
  ☆79Sep 16, 2017Updated 8 years ago
• sunxiaowei2014 / weibo4j-oauth2-beta3.1.1

  View on GitHub
  weibo4j-oauth2-beta3.1.1 sdk
  ☆187Aug 4, 2014Updated 11 years ago
• brianway / webporter

  View on GitHub
  基于 webmagic 的 Java 爬虫应用
  ☆2,771Jan 8, 2022Updated 4 years ago
• shanelau / weibo_comment

  View on GitHub
  新浪微博的评论数据抓取和分析
  ☆94Apr 6, 2015Updated 11 years ago
• zifangsky / WeatherSpider

  View on GitHub
  天气爬虫（全国城镇天气自动定时抓取更新，并开放RESTful查询接口），附带代理IP池定时更新并检测其可用性
  ☆364Jun 25, 2018Updated 8 years ago
• langke93 / rest-nettyserver

  View on GitHub
  基于netty通信框架的轻量级、高性能RESTful服务，用于构建分布式系统。
  ☆123Jan 2, 2013Updated 13 years ago