HaiQW/webspiders external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

HaiQW/webspiders

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/HaiQW/webspiders)

Close

HaiQW / webspidersView on GitHubMore

• External links
• Readme badge

基于Scrapy的网络（微薄and知乎)爬虫(A weibo spider written in Scrapy)

☆16Apr 19, 2016Updated 10 years ago

Alternatives and similar repositories for webspiders

Users that are interested in webspiders are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• xioxu / sinaWeiboLogin

  View on GitHub
  想要抓取新浪微博数据，必须先要登录，但新浪也做了一定的预防措施，这是我用c#写了一个使用http模拟登录新浪微博的示例代码。
  ☆11Oct 22, 2014Updated 11 years ago
• alexayan / weibo_repost_python

  View on GitHub
  抓取微博转发关系数据，weibo repost
  ☆10Nov 16, 2015Updated 10 years ago
• phospher / WeiboSpider

  View on GitHub
  A Spider for grapping weibo text from weibo(Sina, Tencent and so on)
  ☆21Oct 25, 2013Updated 12 years ago
• sunshinenum / sina_news

  View on GitHub
  基于Scrapy的爬虫，爬取新浪新闻，数据库使用mysql和mongoDB附带master分支docker镜像。
  ☆18Aug 9, 2016Updated 9 years ago
• yoyzhou / weibo_scrapy

  View on GitHub
  WEIBO_SCRAPY is a Multi-Threading SINA WEIBO data extraction Framework in Python.
  ☆155Jul 28, 2017Updated 8 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• Ncerzzk / weibo

  View on GitHub
  login weibo
  ☆18Feb 24, 2015Updated 11 years ago
• zhangtianyi1234 / sinaweibo

  View on GitHub
  python request写的新浪微博登录，发帖，转发，关注方法，没有使用sina 官方API，使用python request请求完成
  ☆20Jul 19, 2017Updated 8 years ago
• LabsCluster / WeiboPredict

  View on GitHub
  感谢大家的pull request
  ☆17Oct 21, 2015Updated 10 years ago
• gpxlcj / weibospider

  View on GitHub
  A Web Spider for Weibo(Chinese Twitter)
  ☆18Aug 12, 2015Updated 10 years ago
• Lendfating / SinaLogin

  View on GitHub
  自动登录sina微博，主要为后续开发爬虫做的基础性工作
  ☆23Mar 9, 2013Updated 13 years ago
• wanghuafeng / baidu_spider

  View on GitHub
  百度爬虫：热词，词频，音乐，poi信息
  ☆21Mar 10, 2015Updated 11 years ago
• Kevinsss / weibo_spider

  View on GitHub
  Weibo Spider
  ☆24Jun 3, 2016Updated 9 years ago
• sjhfx / Rweibo

  View on GitHub
  An interface to the Weibo open platform
  ☆13Mar 23, 2020Updated 6 years ago
• clopso / tweetext

  View on GitHub
  Find ALL old tweets with the Wayback Machine (Including from disabled accounts)
  ☆14Jul 12, 2023Updated 2 years ago
• Deploy to Railway using AI coding agents - Free Credits Offer • Ad
  Use Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
• NoCLin / vue-json-template

  View on GitHub
  simple buildless template engine by *.vue component
  ☆10Dec 4, 2022Updated 3 years ago
• Randy-whiteSugar / LagouSpider_Scrapy

  View on GitHub
  使用Scrapy编写的拉勾网爬虫，添加了代理IP池、增量爬取机制
  ☆11May 22, 2023Updated 3 years ago
• CriztianiX / lapis-elasticsearch

  View on GitHub
  Model support for elasticsearch
  ☆11Nov 7, 2016Updated 9 years ago
• leafo / lapis-site

  View on GitHub
  The homepage for Lapis
  ☆15Apr 24, 2026Updated last month
• sparkica / refine-stats

  View on GitHub
  A statistics extension for Google Refine.
  ☆26Jan 25, 2013Updated 13 years ago
• lishuhuakai / TinyYACC

  View on GitHub
  用cpp编写的一个实现了最核心功能的YACC,供练习使用.
  ☆10Aug 28, 2017Updated 8 years ago
• Treeeater / vulCheckerFirefox

  View on GitHub
  ☆10Jan 14, 2015Updated 11 years ago
• leonov-av / vulnkbdiff

  View on GitHub
  Vulnerability Knowledge Base comparison tool
  ☆13Feb 9, 2022Updated 4 years ago
• wanghuafeng / zhihu_spider

  View on GitHub
  知乎爬虫---知乎点赞数超过1000的问题及回答，知乎神回复
  ☆23May 10, 2016Updated 10 years ago
• Managed Database hosting by DigitalOcean • Ad
  PostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
• RobRomijnders / dan

  View on GitHub
  Domain Agnostic Normalization layer for Unsupervised Domain Adaptation
  ☆11Dec 8, 2022Updated 3 years ago
• wangfangye / kg-hongloumeng

  View on GitHub
  红楼梦数据集知识图谱
  ☆16Oct 13, 2020Updated 5 years ago
• vislee / ngx_http_waf_module

  View on GitHub
  High-performance Simple-rule Easy-extend web application firewall(WAF) module for Nginx.
  ☆10Jan 1, 2019Updated 7 years ago
• hrbrmstr / elpresidente

  View on GitHub
  🇺🇸 Search and Extract Corpus Elements from 'The American Presidency Project'
  ☆20Apr 23, 2018Updated 8 years ago
• bungle / lua-resty-injection

  View on GitHub
  LuaJIT FFI bindings to libinjection (https://github.com/client9/libinjection)
  ☆16Sep 15, 2016Updated 9 years ago
• audreylim / mini-shell

  View on GitHub
  A toy Unix shell written in Go.
  ☆14Aug 16, 2015Updated 10 years ago
• serranoarevalo / corfu

  View on GitHub
  Beautiful Modern React UI Kit
  ☆11Dec 24, 2018Updated 7 years ago
• boyxiaolong / django_blog

  View on GitHub
  A person blog developed by django
  ☆10May 30, 2016Updated 9 years ago
• meibenjin / weibo_crawler

  View on GitHub
  微博搜索结果爬取工具
  ☆27Nov 24, 2014Updated 11 years ago
• Open source password manager - Proton Pass • Ad
  Securely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
• christiancscott / awesome-LLM-security

  View on GitHub
  A compendium of threat modeling and security testing resources for LLMs and GenAI agents
  ☆19Oct 16, 2024Updated last year
• katreparitosh / Discourse-Analytics-of-Political-Speech-Transcripts

  View on GitHub
  Political Discourse Analysis (PDA) of Political Speech Transcripts using Natural Language Processing (NLP)
  ☆16Apr 28, 2021Updated 5 years ago
• Pchank / Visual-Saliency-Papers

  View on GitHub
  This repo contains most of outstanding papers on visual saliency (2013-2017).
  ☆10Dec 6, 2017Updated 8 years ago
• gisfromscratch / gdelt-notebooks

  View on GitHub
  Sample notebooks for using the Global Database of Events, Language and Tone (GDELT).
  ☆19Nov 8, 2020Updated 5 years ago
• davidbroska / Computational-Political-Science

  View on GitHub
  Repository for Computational Political Science course at Zeppelin University
  ☆17May 4, 2021Updated 5 years ago
• kellycotton / TidyTuesdays

  View on GitHub
  ☆13Sep 29, 2021Updated 4 years ago
• Graylog2 / graylog-plugin-sample

  View on GitHub
  Sample plugin for Graylog 2.0 including web ui parts.
  ☆10Feb 7, 2024Updated 2 years ago