younghz/scrapy-redis external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

younghz/scrapy-redis

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/younghz/scrapy-redis)

Close

younghz / scrapy-redisView on GitHubMore

• External links
• Readme badge

Redis-based components for scrapy that allows distributed crawling

☆46Sep 6, 2014Updated 11 years ago

Alternatives and similar repositories for scrapy-redis

Users that are interested in scrapy-redis are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• fengxiaochuang / ScrapyDemo

  View on GitHub
  ScrapyDemo : Redis MySQLdb logging IngoreHttpRequestMiddleware UserAgentMiddleware HttpProxyMiddleware rules
  ☆38Jun 28, 2016Updated 9 years ago
• qcl643062 / spider

  View on GitHub
  ☆30Jul 25, 2016Updated 9 years ago
• 0neSe7en / jd-comments

  View on GitHub
  抓取京东商城的评论信息与商品信息. 过滤无价值的评论,并展示.
  ☆17Sep 27, 2016Updated 9 years ago
• KDF5000 / RSpider

  View on GitHub
  一个基于scrapy-redis的分布式爬虫模板
  ☆43Jul 4, 2017Updated 8 years ago
• jackgitgz / CnblogsSpider

  View on GitHub
  用scrapy采集cnblogs列表页爬虫
  ☆274Jun 16, 2015Updated 10 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• zhchbin / KM

  View on GitHub
  My personal knowledge management.
  ☆18Sep 26, 2014Updated 11 years ago
• somethingx64 / SinaMicroblog_Creeper-Spider_VerificationCode

  View on GitHub
  A creeper used to catch concerns and fans in sina microblog. It can imitate login. When encountered with verification code,it shall down …
  ☆21Mar 10, 2016Updated 10 years ago
• mtianyan / DjangoGetStarted

  View on GitHub
  Django搭建在线教育平台前置小练习-留言板
  ☆37Jan 31, 2018Updated 8 years ago
• KeithYue / Zhihu_Spider

  View on GitHub
  Scrapy the Zhihu content and user social network information
  ☆46Feb 15, 2014Updated 12 years ago
• gnemoug / distribute_crawler

  View on GitHub
  使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现
  ☆3,243Apr 18, 2017Updated 9 years ago
• younghz / TBBKAnalysis

  View on GitHub
  关于淘宝“爆款”数据爬取与分析。具体分析见 —
  ☆189Oct 16, 2018Updated 7 years ago
• Ivanqi / RedisDataStructure

  View on GitHub
  Redis2 和 Redis5数据结构
  ☆10Mar 22, 2022Updated 4 years ago
• BIGBird1994 / qichacha-weixin

  View on GitHub
  charles 抓包获取qichacha微信小程序接口链接，没有反爬限制
  ☆14Feb 1, 2018Updated 8 years ago
• ssdb / phpssdb

  View on GitHub
  use https://github.com/ideawu/ssdb/tree/master/api/php
  ☆22Mar 22, 2016Updated 10 years ago
• Deploy to Railway using AI coding agents - Free Credits Offer • Ad
  Use Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
• bowenpay / django-wechat

  View on GitHub
  微信公众号 django 开发库
  ☆19Mar 29, 2017Updated 9 years ago
• tuber / PHP_APP_RSA_AES

  View on GitHub
  PHP和客户端分别用RSA交换aes key，并实现加密解密过程
  ☆16Mar 29, 2017Updated 9 years ago
• rmax / scrapy-redis

  View on GitHub
  Redis-based components for Scrapy.
  ☆5,634May 19, 2026Updated last week
• gusibi / Django-Simple-Todo

  View on GitHub
  simple-todo dajngo版
  ☆31Nov 29, 2016Updated 9 years ago
• TeamHG-Memex / tor-proxy

  View on GitHub
  a tor socks proxy docker image
  ☆12Apr 8, 2026Updated last month
• sjchoi86 / reinforcement-learning

  View on GitHub
  Implementation of Reinforcement Learning Algorithms. Python, OpenAI Gym, Tensorflow. Exercises and Solutions to accompany Sutton's Book a…
  ☆12Oct 2, 2016Updated 9 years ago
• xeniagda / Traffic

  View on GitHub
  A little traffic simulator webpage/application written in elm+node.js
  ☆13May 20, 2017Updated 9 years ago
• lipiji / PG_DEEP

  View on GitHub
  demo of deep belief nets
  ☆67Jan 3, 2016Updated 10 years ago
• vln104 / MauticSpamAssassinChecker

  View on GitHub
  SpamAssassin Spam Score checker for Mautic
  ☆11Apr 23, 2016Updated 10 years ago
• Virtual machines for every use case on DigitalOcean • Ad
  Get dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
• begeekmyfriend / geekutils

  View on GitHub
  Utilities for geek.
  ☆10Mar 20, 2016Updated 10 years ago
• hanguofeng / taiji

  View on GitHub
  [MOVED]Taiji is a pusher consumer for kafka.
  ☆12Mar 11, 2016Updated 10 years ago
• nitinsurana / Litecoin-Bitcoin-RPC-Java-Connector

  View on GitHub
  A wrapper around the JSON-RPC provided by the bitcoin/litecoin
  ☆13Nov 9, 2017Updated 8 years ago
• cellier / cellier.github.io

  View on GitHub
  Cellier's blog
  ☆11Apr 22, 2016Updated 10 years ago
• dydx / alpine-mariadb

  View on GitHub
  ☆12Jun 20, 2015Updated 10 years ago
• joylarkin / My-AI-Resource-List

  View on GitHub
  A useful opinionated repository of Artificial Intelligence ecosystem resources - AI event calendars, papers, books, articles, videos, AI …
  ☆21Mar 1, 2026Updated 2 months ago
• Tai7sy / ico-spider

  View on GitHub
  ICO Source Spider, write in NodeJS
  ☆12May 4, 2018Updated 8 years ago
• imchenkun / ick-spider

  View on GitHub
  spider demo
  ☆25Jun 24, 2020Updated 5 years ago
• sysulq / zrpc

  View on GitHub
  A lightweight distributed RPC framework powered by pure C language and based on ZeroMQ and pbc.
  ☆10Mar 4, 2014Updated 12 years ago
• Deploy to Railway using AI coding agents - Free Credits Offer • Ad
  Use Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
• nixuehan / koala

  View on GitHub
  a micro web-framework
  ☆16May 19, 2016Updated 10 years ago
• dabapps / django-user-streams

  View on GitHub
  DEPRECATED: Simple, fast user news feeds for Django
  ☆52Jan 2, 2019Updated 7 years ago
• istresearch / scrapy-cluster

  View on GitHub
  This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
  ☆1,226Nov 7, 2023Updated 2 years ago
• mengning / nezha

  View on GitHub
  哪吒（Nezha）是一个基于Tokyo Cabinet的简单分布式KV存储系统原型。
  ☆10Mar 30, 2013Updated 13 years ago
• sky-ecosystem / spells-kovan

  View on GitHub
  ☆12Sep 1, 2021Updated 4 years ago
• xushun007 / annotated_memcached

  View on GitHub
  对memecached1.4.15核心源码进行注释
  ☆12Jul 29, 2014Updated 11 years ago
• lkaihua / Bipeline

  View on GitHub
  A Web-Based Visualization Tool for Biclustering of Multivariate Time Series
  ☆10Feb 17, 2023Updated 3 years ago