yuki-lau/weibo-spider external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

yuki-lau/weibo-spider

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/yuki-lau/weibo-spider)

Close

yuki-lau / weibo-spiderView on GitHubMore

• External links
• Readme badge

新浪微博爬虫，采用Java语言开发，基于HTTPClient 4.0，采用MySQL存储爬取数据，支持多进程并发执行。功能包括：爬取微博、评论、转发、关注列表（层次）。根据数据需求，持续更新...

☆353Feb 27, 2014Updated 12 years ago

Alternatives and similar repositories for weibo-spider

Users that are interested in weibo-spider are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• matuobasyouca / spider

  View on GitHub
  a simple distributed spider in Java. Java编写的一个简单分布式爬虫
  ☆160Jun 18, 2013Updated 13 years ago
• JFanZhao / spider

  View on GitHub
  使用java+httpclient+httpcleaner，多线程、分布式爬去电商网站商品信息，数据存储在hbase上，并使用solr对商品建立索引，使用redis队列存储一个共享的url仓库；使用zookeeper对爬虫节点生命周期进行监视等。
  ☆233Nov 6, 2020Updated 6 years ago
• JiaoPaner / WeiboSpider

  View on GitHub
  一个基于微博用户数据的Java爬虫项目
  ☆316Aug 18, 2020Updated 6 years ago
• KKys / ZhiHuSpider

  View on GitHub
  Java无框架实现爬取知乎用户信息、图片和知乎推荐内容并下载到本地或数据库中
  ☆388Jan 21, 2017Updated 9 years ago
• fullstackyang / weibo-crawler

  View on GitHub
  新型的免登录微博爬虫，自动获取Cookie直接进行抓取和解析微博数据，免去了账号登录的过程，彻底摆脱账号被封的困扰
  ☆37Oct 15, 2017Updated 9 years ago
• 1-Click AI Models by DigitalOcean Gradient • Ad
  Deploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
• wycm / zhihu-crawler

  View on GitHub
  zhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目
  ☆918Apr 2, 2019Updated 7 years ago
• yangwx1402 / wb_wx_zh_tt

  View on GitHub
  新浪微博，微信，知乎，头条爬虫，支持新浪登录打码获取cookie实现登录
  ☆16Jul 3, 2017Updated 9 years ago
• thegodofwar / Spider

  View on GitHub
  利用HttpClient4+实现网络小说爬虫，可动态添加热门的小说网站
  ☆30Sep 6, 2012Updated 14 years ago
• xiaoyang611 / crawler-denfender

  View on GitHub
  反网页爬虫系统
  ☆39Mar 10, 2015Updated 11 years ago
• hemin1003 / java-spider

  View on GitHub
  一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集成功能）等资讯内容，配合elasticsearch框架用法，实现了自动爬虫，已投入线上生产使用。
  ☆338Nov 16, 2022Updated 3 years ago
• QiuMing / zhihuWebSpider

  View on GitHub
  知乎爬虫，基于webmagic框架 .A java web spider base on webmagic.
  ☆70May 26, 2016Updated 10 years ago
• shenbaise / goodcrawler

  View on GitHub
  网络爬虫
  ☆49Mar 18, 2014Updated 12 years ago
• advanced-programs / weibo-service

  View on GitHub
  微博数据分析服务框架。
  ☆12Nov 10, 2015Updated 10 years ago
• liuzheng / weibo

  View on GitHub
  新浪weibo微博抓取，Python3 support
  ☆76Feb 20, 2017Updated 9 years ago
• Simple, predictable pricing with DigitalOcean hosting • Ad
  Always know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
• qiyaTech / javaCrawling

  View on GitHub
  "奇伢爬虫"是基于sprint boot 、 WebMagic 实现 微信公众号文章、新闻、csdn、info等网站文章爬取，可以动态设置文章爬取规则、清洗规则，基本实现了爬取大部分网站的文章。
  ☆323Sep 3, 2017Updated 9 years ago
• yinchuandong / DistributedCrawler

  View on GitHub
  java分布式爬虫，主机和从机控制的机制
  ☆14May 21, 2015Updated 11 years ago
• sunxiaowei2014 / weibo4j-oauth2-beta3.1.1

  View on GitHub
  weibo4j-oauth2-beta3.1.1 sdk
  ☆187Aug 4, 2014Updated 12 years ago
• CrawlScript / WebCollector

  View on GitHub
  WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup …
  ☆3,078Feb 10, 2026Updated 8 months ago
• canghaiyisu666 / spider

  View on GitHub
  爬虫项目源码整理，使用redis进行url缓存，hbase进行详细信息的存储。使用zookeeper进行爬虫线程的状态监控。
  ☆17Oct 7, 2015Updated 11 years ago
• BluesTroy / seckill

  View on GitHub
  商品秒杀系统——Java并发实战和并发优化
  ☆12Oct 6, 2016Updated 10 years ago
• code4craft / webmagic

  View on GitHub
  A scalable web crawler framework for Java.
  ☆11,668Dec 20, 2025Updated 10 months ago
• zifangsky / WeatherSpider

  View on GitHub
  天气爬虫（全国城镇天气自动定时抓取更新，并开放RESTful查询接口），附带代理IP池定时更新并检测其可用性
  ☆363Jun 25, 2018Updated 8 years ago
• zoopaper / design-pattern

  View on GitHub
  设计模式
  ☆10Jun 13, 2023Updated 3 years ago
• Deploy to Railway using AI coding agents - Free Credits Offer • Ad
  Use Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
• zhegexiaohuozi / SeimiCrawler

  View on GitHub
  一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.
  ☆1,986Oct 15, 2026Updated 3 weeks ago
• zongtui / zongtui-webcrawler

  View on GitHub
  基于hadoop思维的分布式网络爬虫。
  ☆85Mar 8, 2016Updated 10 years ago
• LiuXingMing / SinaSpider

  View on GitHub
  新浪微博爬虫（Scrapy、Redis）
  ☆3,281Sep 5, 2018Updated 8 years ago
• gsh199449 / spider

  View on GitHub
  A configurable web spider with a easy-to-use web console
  ☆996Jun 3, 2026Updated 5 months ago
• MatrixSeven / ZhihuSpider

  View on GitHub
  知乎爬虫/可以爬出关注关系的爬虫
  ☆303Jun 7, 2025Updated last year
• ycloudnet / ya100

  View on GitHub
  一个比Spark-Parquet还快5~100倍的存储格式
  ☆12Feb 22, 2016Updated 10 years ago
• adealjason / dtsopensource

  View on GitHub
  基于二阶提交理论实现的分布式事务服务框架
  ☆27Dec 24, 2016Updated 9 years ago
• xtuhcy / gecco

  View on GitHub
  Easy to use lightweight web crawler（易用的轻量化网络爬虫）
  ☆2,512Oct 9, 2026Updated 3 weeks ago
• jxqlovejava / PopularBlogSites

  View on GitHub
  个人收集的觉得不错的技术站点或技术博客
  ☆219Feb 1, 2018Updated 8 years ago
• End-to-end encrypted email - Proton Mail • Ad
  Special offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
• gsh199449 / DistributeCrawler

  View on GitHub
  基于Map/Reduce爬虫,可抽取各大新闻网站的新闻正文并进行分类和聚类
  ☆74Jan 5, 2014Updated 12 years ago
• ml-distribution / negative-sentiment

  View on GitHub
  基于词典的负面舆情信息评分算法。
  ☆25Dec 16, 2014Updated 11 years ago
• gsh199449 / DistributedCrawler

  View on GitHub
  DistributeCrawler的Maven版
  ☆10Jun 20, 2022Updated 4 years ago
• brianway / webporter

  View on GitHub
  基于 webmagic 的 Java 爬虫应用
  ☆2,765Jan 8, 2022Updated 4 years ago
• decaywood / XueQiuSuperSpider

  View on GitHub
  雪球股票信息超级爬虫
  ☆2,447Mar 27, 2024Updated 2 years ago
• Siriuser / WeiboCrawler

  View on GitHub
  新浪微博搜索工具
  ☆44Feb 22, 2013Updated 13 years ago
• cqbc / Graduation-Design

  View on GitHub
  网络舆情爬虫 实现元搜索(MetaSearch)和随机URL(主要是五大门户网站)的抓取。
  ☆13Sep 26, 2016Updated 10 years ago