tenlee2012/scrapy-kafka-redis external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

tenlee2012/scrapy-kafka-redis

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/tenlee2012/scrapy-kafka-redis)

Close

tenlee2012 / scrapy-kafka-redisView on GitHubMore

• External links
• Readme badge

Distributed crawling/scraping, Kafka And Redis based components for Scrapy

☆46Nov 13, 2020Updated 5 years ago

Alternatives and similar repositories for scrapy-kafka-redis

Users that are interested in scrapy-kafka-redis are comparing it to the libraries listed below

• AaronJny / scrapy_redis_expiredupefilter

  View on GitHub
  scrapy-redis-expiredupefilter是基于scrapy-redis修改来的一款scrapy分布式爬虫框架，它支持为请求指纹设置生命周期，请求指纹生命周期结束后将在不影响其他指纹的情况下自动清除。
  ☆10Aug 6, 2019Updated 6 years ago
• jinuljt / wechat-web-auth

  View on GitHub
  对微信网页授权获取用户信息的封装
  ☆10Jul 30, 2015Updated 10 years ago
• Liangchengdeye / Requests_Html_Spider

  View on GitHub
  requests升级版requests-html 爬虫编写及通用爬虫模块搭建
  ☆11Nov 21, 2018Updated 7 years ago
• OneJane / OneJane.github.io

  View on GitHub
  个人博客
  ☆13Feb 2, 2023Updated 3 years ago
• samuelyao314 / nsqbook

  View on GitHub
  nsq官方文档翻译和源码学习
  ☆11Sep 10, 2014Updated 11 years ago
• locoz666 / switch-cloud

  View on GitHub
  Nintendo Switch 云游戏！
  ☆12May 8, 2020Updated 5 years ago
• traceless / awkward-proxy

  View on GitHub
  在内网中使用代理上互联网
  ☆10Mar 7, 2023Updated 3 years ago
• Cospel / kaggle-rossmann

  View on GitHub
  Prediction model for Kaggle/Rossmann competition.
  ☆13Nov 23, 2015Updated 10 years ago
• CrazyLittleArmy / DocumentPreview

  View on GitHub
  一款优秀的在线文件预览解决方案，，使用主流springboot+maven搭建，支持doc、docx、ppt、pptx、xls、xlsx、zip、rar、mp4、mp3以及众多类文本如txt、html、xml、java、properties、sql、js、md、json、c…
  ☆16Dec 6, 2022Updated 3 years ago
• sosedoff / nginx2influxdb

  View on GitHub
  Stream Nginx logs directly into InfluxDB
  ☆14Sep 22, 2017Updated 8 years ago
• arkady-emelyanov / kafkabeat

  View on GitHub
  Kafka event forwarder build on top of Elastic Beats platform
  ☆12Apr 29, 2019Updated 6 years ago
• Germey / AdslProxy

  View on GitHub
  ☆17Jul 14, 2017Updated 8 years ago
• Gerapy / GerapyAutoExtractor

  View on GitHub
  Auto Extractor Module
  ☆334Aug 19, 2024Updated last year
• BruceDone / clock

  View on GitHub
  可视化任务调度系统，精简到一个二进制文件 (Web visual task scheduler system , yes ! just one binary solve all the problems !)
  ☆194Jan 11, 2026Updated last month
• LIANSAI / Customers-purchase-Prediction

  View on GitHub
  招商消费金融场景下的用户购买预测 34th 方案
  ☆23Jul 21, 2018Updated 7 years ago
• tejasmagia / DetectCarParkingSlot_Contest

  View on GitHub
  Detecting car parking slot on Open car park space
  ☆13Oct 21, 2019Updated 6 years ago
• sql-machine-learning / pysqlflow

  View on GitHub
  SQLFlow client library for Python
  ☆29Feb 11, 2023Updated 3 years ago
• asyncins / antispider

  View on GitHub
  书籍《Python3 反爬虫原理与绕过实战》配套代码
  ☆627Oct 25, 2021Updated 4 years ago
• Python3WebSpider / ScrapyUniversal

  View on GitHub
  Scrapy Universal Spider
  ☆56Aug 26, 2017Updated 8 years ago
• elacuesta / scrapy-pyppeteer

  View on GitHub
  Pyppeteer integration for Scrapy
  ☆58Feb 26, 2021Updated 5 years ago
• rangertaha / scrapy-prometheus-exporter

  View on GitHub
  Scrapy stats exporter for prometheus
  ☆22Aug 22, 2025Updated 6 months ago
• Python3WebSpider / ScrapyPyppeteerDeprecated

  View on GitHub
  Scrapy Pyppeteer Demo
  ☆24Jul 13, 2018Updated 7 years ago
• kingname / TeamFlowy

  View on GitHub
  A simple sync tool to sync task from Workflowy to Teambition
  ☆32Oct 4, 2017Updated 8 years ago
• kingname / EverFlowy

  View on GitHub
  Sync your workflowy's items into evernote
  ☆32Dec 8, 2022Updated 3 years ago
• Accenture / mercury-composable

  View on GitHub
  Reference implementation toolkit for writing composable applications
  ☆22Updated this week
• DeepSemantics / comparator-network

  View on GitHub
  基于ComNet的短文本匹配网络模型
  ☆11Jul 9, 2019Updated 6 years ago
• yanivle / fast_minbpe

  View on GitHub
  ☆17Feb 6, 2025Updated last year
• mohuishou / Go-000

  View on GitHub
  ☆28Apr 20, 2021Updated 4 years ago
• julien-duponchelle / scrapy-graphite

  View on GitHub
  Output scrapy statistics to graphite/carbon
  ☆54Mar 9, 2013Updated 13 years ago
• aleechou / 163ui

  View on GitHub
  网易有爱魔兽插件包
  ☆24Jan 16, 2015Updated 11 years ago
• yinkaisheng / WindowsUpdateKB971513ForIUIAutomation

  View on GitHub
  Windows Update KB971513 for IUIAutomation, The XP version link is dead on https://support.microsoft.com/en-us/kb/971513. Here is a copy.
  ☆12Oct 20, 2016Updated 9 years ago
• siseng / siseng.github.io

  View on GitHub
  homepage
  ☆10Feb 15, 2023Updated 3 years ago
• KyleYoung1997 / DNNorDermatologist

  View on GitHub
  Supporting code for Deep Neural Network or Dermatologist?
  ☆10Nov 14, 2019Updated 6 years ago
• fdouetteau / PyMapReduce

  View on GitHub
  Simple MapReduce implementation in Python, for text file parallel processing
  ☆20Mar 3, 2012Updated 14 years ago
• yjfiejd / Sales_prediction

  View on GitHub
  Rossmann Store Sales: https://www.kaggle.com/c/rossmann-store-sales
  ☆10May 13, 2018Updated 7 years ago
• DIYer22 / auto_merge_ppt

  View on GitHub
  自动排序并合并ppt
  ☆10Aug 24, 2017Updated 8 years ago
• Maskvvv / easy-flink-cdc

  View on GitHub
  一个基于 Flink CDC 的 CDC 框架，mysql，binlog
  ☆12Apr 8, 2024Updated last year
• c137ff / n8nauts

  View on GitHub
  ☆12Jul 20, 2025Updated 7 months ago
• Lynnn96 / AB_testing_final_project_udacity

  View on GitHub
  This is a A/B test project from Udacity.
  ☆12Dec 24, 2019Updated 6 years ago