Yanxueshan/Scrapy-Redis-Zhihu external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

Yanxueshan/Scrapy-Redis-Zhihu

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/Yanxueshan/Scrapy-Redis-Zhihu)

Close

Yanxueshan / Scrapy-Redis-ZhihuView on GitHubMore

• External links
• Readme badge

基于scrapy-redis实现分布式爬虫，爬取知乎所有问题及对应的回答，集成selenium模拟登录、英文验证码及倒立文字验证码识别、随机生成User-Agent、IP代理、处理302重定向问题等等

☆61Apr 3, 2019Updated 7 years ago

Alternatives and similar repositories for Scrapy-Redis-Zhihu

Users that are interested in Scrapy-Redis-Zhihu are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• shikanon / proxy_scrapy

  View on GitHub
  proxy_scrapy是一个scrapy搭建的代理模块，主要包括代理抓取、代理测试和使用代理三个模块。包括了对主要的代理网站的抓取和代理稳定性的测试，并整合进scrapy爬虫当中。
  ☆10Jan 20, 2017Updated 9 years ago
• Yanxueshan / Python-DataStructur

  View on GitHub
  使用python实现常用的数据结构，包括数组/链表/队列/栈/集合/映射/二分搜索树/最大堆/线段树/Trie/并查集/AVL树/哈希表
  ☆11Mar 19, 2019Updated 7 years ago
• Mocha-Pudding / Scrapy-Redis_Demos

  View on GitHub
  Python分布式爬虫学习笔记，各种Demo同步
  ☆12Aug 21, 2019Updated 6 years ago
• g7rhythm / MYcifar255

  View on GitHub
  卷积神经网络算法处理图片识别 最大255个品类。 1，根据tensorflow -cifar10 示例 改进，以便适应更多图片与分类。2，完善打包图片到Bin文件的生成机制
  ☆11Feb 2, 2023Updated 3 years ago
• zhangslob / awesome_crawl

  View on GitHub
  腾讯新闻、知乎话题、微博粉丝，Tumblr爬虫、斗鱼弹幕、妹子图爬虫、分布式设计等
  ☆303Jun 6, 2025Updated 11 months ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• dengqiangxi / zhihu_spider

  View on GitHub
  知乎爬虫，用于爬取用户信息以及用户之间关系。
  ☆33Nov 22, 2022Updated 3 years ago
• smilemilk1992 / scrapy_redis_mongodb

  View on GitHub
  基于Python+scrapy+redis的分布式爬虫实现框架
  ☆59Jan 6, 2020Updated 6 years ago
• inlike / CookiePool

  View on GitHub
  一个强大的Cookie池项目，融合scrapy/requests/chrome储存cookie/cookie字符串/selenium等cookie形式
  ☆233Mar 13, 2020Updated 6 years ago
• 2223021975 / scrapy-spider-tweets_infomation-Forming-a-user-portrait

  View on GitHub
  爬取微博数据形成用户画像 登陆账号获取cookies 使用selenium，先调用chrome浏览器 最后改成PhantomJS，并根据其中的内容获取想要的数据
  ☆11Mar 7, 2019Updated 7 years ago
• pujinxiao / douban_login

  View on GitHub
  scrapy豆瓣的模拟登录和验证码处理
  ☆49Apr 6, 2017Updated 9 years ago
• Jaysong2012 / tutorial

  View on GitHub
  Scrapy爬虫实战系列，从零开始爬取腾讯百度淘宝知乎各大网站内容 \n 12306刷票脚本系列
  ☆80Apr 2, 2019Updated 7 years ago
• Baiyuetribe / watermark-img

  View on GitHub
  可能是全网最方便的水印图床，支持宝塔一键部署、也支持Docker版部署至服务器或本地电脑
  ☆10Jul 16, 2019Updated 6 years ago
• Lucareful / JingDongSpider

  View on GitHub
  基于scrapy框架的京东爬虫实现
  ☆11Nov 22, 2019Updated 6 years ago
• bloossoms / xiecheng_hotel_reviews_spider

  View on GitHub
  基于selenium的携程酒店评论爬取
  ☆13May 10, 2021Updated 5 years ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• Mcliuyi / Light-Short-text-product-classification

  View on GitHub
  淘宝，京东，苏宁Scrapy爬虫
  ☆10Dec 8, 2022Updated 3 years ago
• SchrodingersBug / CSDN_SearchEngine

  View on GitHub
  通过CSDN爬虫爬取博客，利用Whoosh实现倒排索引与排序，django作为后端实现小型CSDN搜索引擎。并实现高亮、相关搜索等功能。
  ☆30Nov 8, 2018Updated 7 years ago
• Jeffz615 / v-song-list

  View on GitHub
  幽灵车尔尼桑的直播歌单-纯静态部署
  ☆13Sep 29, 2025Updated 7 months ago
• sdogsq / ctrip-hotel-spider

  View on GitHub
  selenium 携程酒店爬虫+简单数据分析
  ☆10Dec 6, 2018Updated 7 years ago
• yangshimin / ast_study

  View on GitHub
  记录AST学习
  ☆51Jan 21, 2022Updated 4 years ago
• shisiying / tc_zufang

  View on GitHub
  使用scrapy,redis, mongodb,django实现的一个分布式网络爬虫,底层存储mongodb,分布式使用redis实现,使用django可视化爬虫
  ☆281May 1, 2018Updated 8 years ago
• lrtdc / book_ldrtc

  View on GitHub
  《分布式实时计算框架原理及实践案例》一书中相关章节实例介绍
  ☆11Jul 11, 2016Updated 9 years ago
• tmliang / Taobao_Spider

  View on GitHub
  基于Scrapy的Python3分布式淘宝爬虫
  ☆191Mar 11, 2021Updated 5 years ago
• LoseUFaith / WOS_crawler

  View on GitHub
  利用 selenium 自动化控制 Chrome 浏览器以 Excel 格式导出 Web of Science 搜索结果
  ☆11Aug 15, 2022Updated 3 years ago
• AI Agents on DigitalOcean Gradient AI Platform • Ad
  Build production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
• dagege1993 / scrapy

  View on GitHub
  1,huaproject算福利吧,爬取的中国校花网,并且保存到本地,基础知识点,url,json,文件的读写. 2,Document.doc 是自己总结的常见爬虫面试题以及答案,但是貌似不想做全职爬虫,所以可能以后也不会更新这一块,爬虫算乐趣, 以后估计重心会放在web …
  ☆14Jan 24, 2018Updated 8 years ago
• tmpbook / Django-with-ElasticSearch

  View on GitHub
  当有新的 Blog 被保存时会触发 signals，在 ElasticSearch 中也生成一份并重建索引，最终在 Django 中实现高速查询
  ☆10Jan 6, 2018Updated 8 years ago
• frankness / kb_qa

  View on GitHub
  时序的金融领域知识图谱构建及问答 以年报为数据 jena为框架
  ☆11Aug 16, 2018Updated 7 years ago
• lordlamer / knowledgeroot-obsolete

  View on GitHub
  Knowledgeroot Knowledgebase
  ☆19Jun 5, 2015Updated 10 years ago
• SocratesClub / workshop

  View on GitHub
  The 2017 Workshop of Computational Communication Research
  ☆10Sep 23, 2017Updated 8 years ago
• nwlandry / hypercontagion

  View on GitHub
  Library for epidemics on hypergraphs
  ☆13May 13, 2024Updated last year
• dengzeyuan / gride-layout

  View on GitHub
  基于vue的可视化动态更改网格尺寸/可拖拽，可动态改变大小，网格布局和自由布局（vue-gride-layout/dnd-gride）
  ☆11Jul 20, 2018Updated 7 years ago
• renyan97 / smart-home

  View on GitHub
  采用微信小程序来控制智能家居，包括数据采集显示，远程控制，蓝牙控制，语音控制等。
  ☆11Feb 19, 2019Updated 7 years ago
• xakep666 / asciinema-player

  View on GitHub
  A simple player for asciinema v2 (https://github.com/asciinema/asciinema) casts
  ☆20Nov 2, 2023Updated 2 years ago
• Managed Kubernetes at scale on DigitalOcean • Ad
  DigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
• Johnson0722 / News_scrapy_redis

  View on GitHub
  ☆30Jul 5, 2018Updated 7 years ago
• Python3WebSpider / CodeServer

  View on GitHub
  Code Server
  ☆12Jun 28, 2021Updated 4 years ago
• BaofengZan / hard_decode_trt-windows

  View on GitHub
  https://github.com/shouxieai/hard_decode_trt windows编译版本
  ☆13Sep 8, 2022Updated 3 years ago
• shelmesky / async_chatroom

  View on GitHub
  基于Tornado、Redis、UDP多播的分布式聊天室
  ☆17May 29, 2013Updated 12 years ago
• newdream2017 / fridascript

  View on GitHub
  脚本
  ☆14Dec 9, 2021Updated 4 years ago
• Dushibing / log-visual

  View on GitHub
  日志可视化进阶
  ☆13May 8, 2017Updated 9 years ago
• soheltarir / grpc-django

  View on GitHub
  gRPC Integration with Django Framework
  ☆10Apr 22, 2022Updated 4 years ago