Yanxueshan/Scrapy-Redis-Zhihu external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

Yanxueshan/Scrapy-Redis-Zhihu

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/Yanxueshan/Scrapy-Redis-Zhihu)

Close

Yanxueshan / Scrapy-Redis-ZhihuView on GitHubMore

• External links
• Readme badge

基于scrapy-redis实现分布式爬虫，爬取知乎所有问题及对应的回答，集成selenium模拟登录、英文验证码及倒立文字验证码识别、随机生成User-Agent、IP代理、处理302重定向问题等等

☆61Apr 3, 2019Updated 7 years ago

Alternatives and similar repositories for Scrapy-Redis-Zhihu

Users that are interested in Scrapy-Redis-Zhihu are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• Yanxueshan / Python-DataStructur

  View on GitHub
  使用python实现常用的数据结构，包括数组/链表/队列/栈/集合/映射/二分搜索树/最大堆/线段树/Trie/并查集/AVL树/哈希表
  ☆11Mar 19, 2019Updated 7 years ago
• zhangslob / awesome_crawl

  View on GitHub
  腾讯新闻、知乎话题、微博粉丝，Tumblr爬虫、斗鱼弹幕、妹子图爬虫、分布式设计等
  ☆302Jun 6, 2025Updated last year
• ybsdegit / captcha_geetest_slide

  View on GitHub
  破解极验滑动验证码 geetest_demo
  ☆23May 6, 2019Updated 7 years ago
• dengqiangxi / zhihu_spider

  View on GitHub
  知乎爬虫，用于爬取用户信息以及用户之间关系。
  ☆33Nov 22, 2022Updated 3 years ago
• inlike / CookiePool

  View on GitHub
  一个强大的Cookie池项目，融合scrapy/requests/chrome储存cookie/cookie字符串/selenium等cookie形式
  ☆232Mar 13, 2020Updated 6 years ago
• Deploy open-source AI quickly and easily - Special Bonus Offer • Ad
  Runpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
• smilemilk1992 / scrapy_redis_mongodb

  View on GitHub
  基于Python+scrapy+redis的分布式爬虫实现框架
  ☆59Jan 6, 2020Updated 6 years ago
• ioiogoo / scrapy-monitor

  View on GitHub
  scrapy-monitor，实现爬虫可视化，监控实时状态
  ☆109Dec 26, 2016Updated 9 years ago
• 2223021975 / scrapy-spider-tweets_infomation-Forming-a-user-portrait

  View on GitHub
  爬取微博数据形成用户画像 登陆账号获取cookies 使用selenium，先调用chrome浏览器 最后改成PhantomJS，并根据其中的内容获取想要的数据
  ☆11Mar 7, 2019Updated 7 years ago
• NLPOR / SMP2018-task1

  View on GitHub
  深度学习用于近日头条用户画像
  ☆27Jun 11, 2018Updated 8 years ago
• yangge11 / scrapy_pro

  View on GitHub
  关于5000+站点的scrapy爬虫开发，涉及一些技术架构搭建以及各种反爬方案，详见readme文件
  ☆31Dec 8, 2022Updated 3 years ago
• Jaysong2012 / tutorial

  View on GitHub
  Scrapy爬虫实战系列，从零开始爬取腾讯百度淘宝知乎各大网站内容 \n 12306刷票脚本系列
  ☆80Apr 2, 2019Updated 7 years ago
• OSinoooO / MeituanSpider

  View on GitHub
  美团爬虫，基于scrapy_redis
  ☆23Apr 1, 2019Updated 7 years ago
• pujinxiao / douban_login

  View on GitHub
  scrapy豆瓣的模拟登录和验证码处理
  ☆50Apr 6, 2017Updated 9 years ago
• nkynp74dak / wenzi-sc-shipin

  View on GitHub
  文字自动生成视频 - 文字生成视频的AI工具软件汇总
  ☆14Apr 17, 2025Updated last year
• Virtual machines for every use case on DigitalOcean • Ad
  Get dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
• SchrodingersBug / CSDN_SearchEngine

  View on GitHub
  通过CSDN爬虫爬取博客，利用Whoosh实现倒排索引与排序，django作为后端实现小型CSDN搜索引擎。并实现高亮、相关搜索等功能。
  ☆30Nov 8, 2018Updated 7 years ago
• Riroaki / ZhihuCrawler

  View on GitHub
  【不再维护】知乎爬虫，爬取用户信息和回答；基于Selenium和Scrapy（主要），采用随机ua和ip（需配置）
  ☆17Dec 8, 2022Updated 3 years ago
• leonwgc / antd-form-render

  View on GitHub
  使用 js 配置开发 ant-design 表单
  ☆11Dec 5, 2025Updated 8 months ago
• Lucareful / JingDongSpider

  View on GitHub
  基于scrapy框架的京东爬虫实现
  ☆11Nov 22, 2019Updated 6 years ago
• bloossoms / xiecheng_hotel_reviews_spider

  View on GitHub
  基于selenium的携程酒店评论爬取
  ☆13May 10, 2021Updated 5 years ago
• LwcReber / health_Tracker

  View on GitHub
  health-Tracker 是一个响应式的食物健康应用，用于查询和计算食物的卡路里数。使用 gulp 工具构建，利用 backbone JS 框架搭建应用，使用 Nutritionix API 查询对应的食物卡路里
  ☆14Aug 30, 2017Updated 9 years ago
• Jeffz615 / v-song-list

  View on GitHub
  幽灵车尔尼桑的直播歌单-纯静态部署
  ☆13Sep 29, 2025Updated 11 months ago
• shisiying / tc_zufang

  View on GitHub
  使用scrapy,redis, mongodb,django实现的一个分布式网络爬虫,底层存储mongodb,分布式使用redis实现,使用django可视化爬虫
  ☆278May 1, 2018Updated 8 years ago
• yangshimin / ast_study

  View on GitHub
  记录AST学习
  ☆49Jan 21, 2022Updated 4 years ago
• Deploy to Railway using AI coding agents - Free Credits Offer • Ad
  Use Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
• xiaohutuchong / fly_ticket_book

  View on GitHub
  JSP机票预订系统
  ☆14Jul 15, 2020Updated 6 years ago
• wzf1997 / count-component-plugin

  View on GitHub
  统计项目中一个组件引用次数的 webpack 插件
  ☆12Mar 19, 2022Updated 4 years ago
• LoseUFaith / WOS_crawler

  View on GitHub
  利用 selenium 自动化控制 Chrome 浏览器以 Excel 格式导出 Web of Science 搜索结果
  ☆11Aug 15, 2022Updated 4 years ago
• tmliang / Taobao_Spider

  View on GitHub
  基于Scrapy的Python3分布式淘宝爬虫
  ☆191Mar 11, 2021Updated 5 years ago
• renyan97 / smart-home

  View on GitHub
  采用微信小程序来控制智能家居，包括数据采集显示，远程控制，蓝牙控制，语音控制等。
  ☆11Feb 19, 2019Updated 7 years ago
• openEA-org / osbpm

  View on GitHub
  osbpm企业应用开发平台已加入openEA定向开源计划，平台由广州市联科软件股份有限公司自主研发，严格遵照开源协议Mozilla Public License（MPL） 2.0开放源代码。为保证质量，减少企业应用风险，在初期实施定向开源策略，只有加入openEA定向开源计…
  ☆13Jan 5, 2021Updated 5 years ago
• dagege1993 / scrapy

  View on GitHub
  1,huaproject算福利吧,爬取的中国校花网,并且保存到本地,基础知识点,url,json,文件的读写. 2,Document.doc 是自己总结的常见爬虫面试题以及答案,但是貌似不想做全职爬虫,所以可能以后也不会更新这一块,爬虫算乐趣, 以后估计重心会放在web …
  ☆14Jan 24, 2018Updated 8 years ago
• tmpbook / Django-with-ElasticSearch

  View on GitHub
  当有新的 Blog 被保存时会触发 signals，在 ElasticSearch 中也生成一份并重建索引，最终在 Django 中实现高速查询
  ☆10Jan 6, 2018Updated 8 years ago
• wuyue92tree / crwy

  View on GitHub
  一个简单的web爬虫框架，借鉴scrapy结构开发而来，并为scrapy使用者提供通用轮子^.^
  ☆13Nov 9, 2020Updated 5 years ago
• Proton VPN Special Offer - Get 70% off • Ad
  Special partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
• xakep666 / asciinema-player

  View on GitHub
  A simple player for asciinema v2 (https://github.com/asciinema/asciinema) casts
  ☆20Nov 2, 2023Updated 2 years ago
• Python3WebSpider / CodeServer

  View on GitHub
  Code Server
  ☆12Jun 28, 2021Updated 5 years ago
• LinZiYU1996 / Spring-Boot-Elasticsearch

  View on GitHub
  ☆11May 21, 2018Updated 8 years ago
• Johnson0722 / News_scrapy_redis

  View on GitHub
  ☆30Jul 5, 2018Updated 8 years ago
• Daoming-Chen / AD_study

  View on GitHub
  Study notes in Chinese based on Self-Driving Cars (Prof. Andreas Geiger, University of Tübingen)
  ☆12Aug 4, 2022Updated 4 years ago
• BaofengZan / hard_decode_trt-windows

  View on GitHub
  https://github.com/shouxieai/hard_decode_trt windows编译版本
  ☆13Sep 8, 2022Updated 3 years ago
• DaliZh / DLUDID

  View on GitHub
  iOS上获取唯一UUID，卸载重装之后保证获取UUID不变
  ☆11Jan 18, 2017Updated 9 years ago