Yanxueshan/Scrapy-Redis-Zhihu external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

Yanxueshan/Scrapy-Redis-Zhihu

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/Yanxueshan/Scrapy-Redis-Zhihu)

Close

Yanxueshan / Scrapy-Redis-ZhihuView on GitHubMore

• External links
• Readme badge

基于scrapy-redis实现分布式爬虫，爬取知乎所有问题及对应的回答，集成selenium模拟登录、英文验证码及倒立文字验证码识别、随机生成User-Agent、IP代理、处理302重定向问题等等

☆61Apr 3, 2019Updated 7 years ago

Alternatives and similar repositories for Scrapy-Redis-Zhihu

Users that are interested in Scrapy-Redis-Zhihu are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• shikanon / proxy_scrapy

  View on GitHub
  proxy_scrapy是一个scrapy搭建的代理模块，主要包括代理抓取、代理测试和使用代理三个模块。包括了对主要的代理网站的抓取和代理稳定性的测试，并整合进scrapy爬虫当中。
  ☆10Jan 20, 2017Updated 9 years ago
• Mocha-Pudding / Scrapy-Redis_Demos

  View on GitHub
  Python分布式爬虫学习笔记，各种Demo同步
  ☆12Aug 21, 2019Updated 6 years ago
• zhangslob / awesome_crawl

  View on GitHub
  腾讯新闻、知乎话题、微博粉丝，Tumblr爬虫、斗鱼弹幕、妹子图爬虫、分布式设计等
  ☆303Jun 6, 2025Updated 10 months ago
• dengqiangxi / zhihu_spider

  View on GitHub
  知乎爬虫，用于爬取用户信息以及用户之间关系。
  ☆33Nov 22, 2022Updated 3 years ago
• smilemilk1992 / scrapy_redis_mongodb

  View on GitHub
  基于Python+scrapy+redis的分布式爬虫实现框架
  ☆59Jan 6, 2020Updated 6 years ago
• Managed hosting for WordPress and PHP on Cloudways • Ad
  Managed hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
• inlike / CookiePool

  View on GitHub
  一个强大的Cookie池项目，融合scrapy/requests/chrome储存cookie/cookie字符串/selenium等cookie形式
  ☆233Mar 13, 2020Updated 6 years ago
• ioiogoo / scrapy-monitor

  View on GitHub
  scrapy-monitor，实现爬虫可视化，监控实时状态
  ☆109Dec 26, 2016Updated 9 years ago
• NLPOR / SMP2018-task1

  View on GitHub
  深度学习用于近日头条用户画像
  ☆27Jun 11, 2018Updated 7 years ago
• 2223021975 / scrapy-spider-tweets_infomation-Forming-a-user-portrait

  View on GitHub
  爬取微博数据形成用户画像 登陆账号获取cookies 使用selenium，先调用chrome浏览器 最后改成PhantomJS，并根据其中的内容获取想要的数据
  ☆11Mar 7, 2019Updated 7 years ago
• yangge11 / scrapy_pro

  View on GitHub
  关于5000+站点的scrapy爬虫开发，涉及一些技术架构搭建以及各种反爬方案，详见readme文件
  ☆30Dec 8, 2022Updated 3 years ago
• pujinxiao / douban_login

  View on GitHub
  scrapy豆瓣的模拟登录和验证码处理
  ☆50Apr 6, 2017Updated 9 years ago
• Jaysong2012 / tutorial

  View on GitHub
  Scrapy爬虫实战系列，从零开始爬取腾讯百度淘宝知乎各大网站内容 \n 12306刷票脚本系列
  ☆81Apr 2, 2019Updated 7 years ago
• OSinoooO / MeituanSpider

  View on GitHub
  美团爬虫，基于scrapy_redis
  ☆23Apr 1, 2019Updated 7 years ago
• Lucareful / JingDongSpider

  View on GitHub
  基于scrapy框架的京东爬虫实现
  ☆11Nov 22, 2019Updated 6 years ago
• Wordpress hosting with auto-scaling - Free Trial • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• leonwgc / antd-form-render

  View on GitHub
  使用 js 配置开发 ant-design 表单
  ☆11Dec 5, 2025Updated 4 months ago
• Riroaki / ZhihuCrawler

  View on GitHub
  【不再维护】知乎爬虫，爬取用户信息和回答；基于Selenium和Scrapy（主要），采用随机ua和ip（需配置）
  ☆17Dec 8, 2022Updated 3 years ago
• sdogsq / ctrip-hotel-spider

  View on GitHub
  selenium 携程酒店爬虫+简单数据分析
  ☆10Dec 6, 2018Updated 7 years ago
• yangshimin / ast_study

  View on GitHub
  记录AST学习
  ☆51Jan 21, 2022Updated 4 years ago
• lengyingzi / markdown-haed-number

  View on GitHub
  VScode 插件，标题自动增加序号
  ☆12Mar 3, 2019Updated 7 years ago
• jackgithup / mainWebsitesProject

  View on GitHub
  基于网易邮箱、哔哩哔哩、csdn、豆瓣、脸书、京东、拉钩、链家、猎聘、qq空间、淘宝、推特、微信、知乎的爬虫
  ☆15Mar 22, 2019Updated 7 years ago
• shisiying / tc_zufang

  View on GitHub
  使用scrapy,redis, mongodb,django实现的一个分布式网络爬虫,底层存储mongodb,分布式使用redis实现,使用django可视化爬虫
  ☆281May 1, 2018Updated 7 years ago
• wzf1997 / count-component-plugin

  View on GitHub
  统计项目中一个组件引用次数的 webpack 插件
  ☆12Mar 19, 2022Updated 4 years ago
• luis-r-izquierdo / agent-based-evolutionary-game-dynamics

  View on GitHub
  NetLogo models developed in the book "Agent-Based Evolutionary Game Dynamics"
  ☆10Feb 19, 2026Updated 2 months ago
• Virtual machines for every use case on DigitalOcean • Ad
  Get dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
• myml / webssh

  View on GitHub
  websocket to ssh
  ☆11May 14, 2019Updated 6 years ago
• tmliang / Taobao_Spider

  View on GitHub
  基于Scrapy的Python3分布式淘宝爬虫
  ☆191Mar 11, 2021Updated 5 years ago
• dagege1993 / scrapy

  View on GitHub
  1,huaproject算福利吧,爬取的中国校花网,并且保存到本地,基础知识点,url,json,文件的读写. 2,Document.doc 是自己总结的常见爬虫面试题以及答案,但是貌似不想做全职爬虫,所以可能以后也不会更新这一块,爬虫算乐趣, 以后估计重心会放在web …
  ☆14Jan 24, 2018Updated 8 years ago
• thomasdarimont / prometheus-spring-boot-starter

  View on GitHub
  An unofficial spring-boot-starter for the Prometheus Monitoring System
  ☆12Jan 31, 2017Updated 9 years ago
• tmpbook / Django-with-ElasticSearch

  View on GitHub
  当有新的 Blog 被保存时会触发 signals，在 ElasticSearch 中也生成一份并重建索引，最终在 Django 中实现高速查询
  ☆10Jan 6, 2018Updated 8 years ago
• YIDAOHU / Movie

  View on GitHub
  requests+Flask打造电影库
  ☆14Aug 25, 2018Updated 7 years ago
• wuyue92tree / crwy

  View on GitHub
  一个简单的web爬虫框架，借鉴scrapy结构开发而来，并为scrapy使用者提供通用轮子^.^
  ☆13Nov 9, 2020Updated 5 years ago
• abatsakidis / SupplyChainSimulationAnylogic

  View on GitHub
  Modeling methods of System Dynamics – Supply Chain Simulation using the Anylogic software
  ☆10Jan 8, 2026Updated 3 months ago
• SocratesClub / workshop

  View on GitHub
  The 2017 Workshop of Computational Communication Research
  ☆10Sep 23, 2017Updated 8 years ago
• 1-Click AI Models by DigitalOcean Gradient • Ad
  Deploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
• LinZiYU1996 / Spring-Boot-Elasticsearch

  View on GitHub
  ☆11May 21, 2018Updated 7 years ago
• renyan97 / smart-home

  View on GitHub
  采用微信小程序来控制智能家居，包括数据采集显示，远程控制，蓝牙控制，语音控制等。
  ☆11Feb 19, 2019Updated 7 years ago
• xakep666 / asciinema-player

  View on GitHub
  A simple player for asciinema v2 (https://github.com/asciinema/asciinema) casts
  ☆20Nov 2, 2023Updated 2 years ago
• Johnson0722 / News_scrapy_redis

  View on GitHub
  ☆30Jul 5, 2018Updated 7 years ago
• Python3WebSpider / CodeServer

  View on GitHub
  Code Server
  ☆12Jun 28, 2021Updated 4 years ago
• shelmesky / async_chatroom

  View on GitHub
  基于Tornado、Redis、UDP多播的分布式聊天室
  ☆17May 29, 2013Updated 12 years ago
• Dushibing / log-visual

  View on GitHub
  日志可视化进阶
  ☆13May 8, 2017Updated 8 years ago