HaiQW/webspiders external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

HaiQW/webspiders

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/HaiQW/webspiders)

Close

HaiQW / webspidersView on GitHubMore

• External links
• Readme badge

基于Scrapy的网络（微薄and知乎)爬虫(A weibo spider written in Scrapy)

☆16Apr 19, 2016Updated 10 years ago

Alternatives and similar repositories for webspiders

Users that are interested in webspiders are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• bowenpay / weibo-spider

  View on GitHub
  微博爬虫。通过调用weibo api，而非暴力爬取的方式获取信息。
  ☆32Jul 29, 2016Updated 9 years ago
• burkun / Sinaweibo

  View on GitHub
  新浪微博模拟登录 和 自动发 微博，带图片微博 的python脚本，使用opencv实现读取摄像头上传图片到微博。
  ☆21Feb 27, 2018Updated 8 years ago
• wangshunping / Testing_Python

  View on GitHub
  《Python Testing》翻译
  ☆15Oct 13, 2015Updated 10 years ago
• phospher / WeiboSpider

  View on GitHub
  A Spider for grapping weibo text from weibo(Sina, Tencent and so on)
  ☆21Oct 25, 2013Updated 12 years ago
• yoyzhou / weibo_scrapy

  View on GitHub
  WEIBO_SCRAPY is a Multi-Threading SINA WEIBO data extraction Framework in Python.
  ☆155Jul 28, 2017Updated 8 years ago
• Managed hosting for WordPress and PHP on Cloudways • Ad
  Managed hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
• KeithYue / weibo-keywords-crawler

  View on GitHub
  Crawl the related sina weibo content using the keywords, and save the results to txt file for future use.
  ☆18Oct 20, 2016Updated 9 years ago
• cablate / mcp-doc-forge

  View on GitHub
  MCP server that provides doc forge capabilities
  ☆17Jun 2, 2025Updated 11 months ago
• zhangtianyi1234 / sinaweibo

  View on GitHub
  python request写的新浪微博登录，发帖，转发，关注方法，没有使用sina 官方API，使用python request请求完成
  ☆20Jul 19, 2017Updated 8 years ago
• tpeng / weibosearch

  View on GitHub
  A distributed Sina Weibo Search spider base on Scrapy and Redis.
  ☆147May 31, 2013Updated 12 years ago
• LabsCluster / WeiboPredict

  View on GitHub
  感谢大家的pull request
  ☆17Oct 21, 2015Updated 10 years ago
• Lendfating / SinaLogin

  View on GitHub
  自动登录sina微博，主要为后续开发爬虫做的基础性工作
  ☆23Mar 9, 2013Updated 13 years ago
• wanghuafeng / baidu_spider

  View on GitHub
  百度爬虫：热词，词频，音乐，poi信息
  ☆21Mar 10, 2015Updated 11 years ago
• starryrbs / awesome-scrapy

  View on GitHub
  scrapy实战教程，分享scrapy爬虫的知识，针对各大网站做爬虫采集，并且以实例代码讲解。
  ☆11Jan 22, 2026Updated 3 months ago
• sjhfx / Rweibo

  View on GitHub
  An interface to the Weibo open platform
  ☆13Mar 23, 2020Updated 6 years ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• gakarak / FCN_MSCOCO_Food_Segmentation

  View on GitHub
  Keras Fully Convolutional Neural Network MSCOCO Food Segmentation
  ☆11Apr 11, 2017Updated 9 years ago
• BruceZhaoR / R_Problems

  View on GitHub
  记录R中填过的那些坑
  ☆16Oct 11, 2020Updated 5 years ago
• clopso / tweetext

  View on GitHub
  Find ALL old tweets with the Wayback Machine (Including from disabled accounts)
  ☆14Jul 12, 2023Updated 2 years ago
• NoCLin / vue-json-template

  View on GitHub
  simple buildless template engine by *.vue component
  ☆10Dec 4, 2022Updated 3 years ago
• Randy-whiteSugar / LagouSpider_Scrapy

  View on GitHub
  使用Scrapy编写的拉勾网爬虫，添加了代理IP池、增量爬取机制
  ☆11May 22, 2023Updated 2 years ago
• davyxu / golexer

  View on GitHub
  a flexible lexer by golang
  ☆12Nov 29, 2022Updated 3 years ago
• mstem / archive.org-getter

  View on GitHub
  Ruby script to download bulk results from Archive.org's TV News database of closed captions
  ☆14Mar 20, 2013Updated 13 years ago
• Treeeater / vulCheckerFirefox

  View on GitHub
  ☆10Jan 14, 2015Updated 11 years ago
• tonybaloney / confluence-to-powerpoint

  View on GitHub
  ☆10Aug 2, 2016Updated 9 years ago
• Managed hosting for WordPress and PHP on Cloudways • Ad
  Managed hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
• wanghuafeng / zhihu_spider

  View on GitHub
  知乎爬虫---知乎点赞数超过1000的问题及回答，知乎神回复
  ☆23May 10, 2016Updated 9 years ago
• RobRomijnders / dan

  View on GitHub
  Domain Agnostic Normalization layer for Unsupervised Domain Adaptation
  ☆11Dec 8, 2022Updated 3 years ago
• wangfangye / kg-hongloumeng

  View on GitHub
  红楼梦数据集知识图谱
  ☆16Oct 13, 2020Updated 5 years ago
• helixcn / spaa

  View on GitHub
  Miscellaneous functions for analysis of species association and niche overlap
  ☆12Apr 22, 2022Updated 4 years ago
• everaldo / mcp-mistral-ocr

  View on GitHub
  Model Context Protocol (MCP) Server for Mistral OCR API
  ☆37Feb 21, 2026Updated 2 months ago
• vislee / ngx_http_waf_module

  View on GitHub
  High-performance Simple-rule Easy-extend web application firewall(WAF) module for Nginx.
  ☆10Jan 1, 2019Updated 7 years ago
• yangbendong / GoogleTranslator

  View on GitHub
  A free API for Google Translate. 免费的谷歌翻译，与谷歌翻译网页版相同，可选国内服务器。亲测一日300万字没问题。
  ☆13Nov 22, 2019Updated 6 years ago
• audreylim / mini-shell

  View on GitHub
  A toy Unix shell written in Go.
  ☆14Aug 16, 2015Updated 10 years ago
• serranoarevalo / corfu

  View on GitHub
  Beautiful Modern React UI Kit
  ☆11Dec 24, 2018Updated 7 years ago
• Deploy to Railway using AI coding agents - Free Credits Offer • Ad
  Use Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
• boyxiaolong / django_blog

  View on GitHub
  A person blog developed by django
  ☆10May 30, 2016Updated 9 years ago
• meibenjin / weibo_crawler

  View on GitHub
  微博搜索结果爬取工具
  ☆27Nov 24, 2014Updated 11 years ago
• christiancscott / awesome-LLM-security

  View on GitHub
  A compendium of threat modeling and security testing resources for LLMs and GenAI agents
  ☆19Oct 16, 2024Updated last year
• Pchank / Visual-Saliency-Papers

  View on GitHub
  This repo contains most of outstanding papers on visual saliency (2013-2017).
  ☆10Dec 6, 2017Updated 8 years ago
• xiaooloong / lua-resty-bzlib

  View on GitHub
  openresty luajit ffi bindings for libbzip2 - bzip2 compress library
  ☆12Nov 10, 2016Updated 9 years ago
• gisfromscratch / gdelt-notebooks

  View on GitHub
  Sample notebooks for using the Global Database of Events, Language and Tone (GDELT).
  ☆19Nov 8, 2020Updated 5 years ago
• davidbroska / Computational-Political-Science

  View on GitHub
  Repository for Computational Political Science course at Zeppelin University
  ☆17May 4, 2021Updated 5 years ago