Alternatives and similar repositories for Scrapy-Kafka-Demo:

Users that are interested in Scrapy-Kafka-Demo are comparing it to the libraries listed below

• adrian9631 / CrawlerMonitor
  爬虫监控及可视化 ( Prometheus and Grafana ) Building a crawler with distributed task queues (Celery) and fetching data with a reliable monitor sy…
  ☆45Updated 2 years ago
• aleimu / asyncio_different
  go与python的协程对比,以及python中协程的改进历史,和示例代码
  ☆39Updated 5 years ago
• tenlee2012 / scrapy-kafka-redis
  Distributed crawling/scraping, Kafka And Redis based components for Scrapy
  ☆45Updated 4 years ago
• Metatronxl / phantom
  怪盗キッド（Kaitou Kiddo）
  ☆23Updated 2 years ago
• yoonper / ZooHelper
  ZooKeeper可视化工具
  ☆15Updated 7 years ago
• crawlab-team / crawlab-sdk
  SDK for Crawlab, including SDK for different programming languages such as Python, Node.js and Java, and a CLI Tool written in Python.
  ☆55Updated 10 months ago
• ltachi1 / amasd
  Amasd是一款基于scrapyd的scrapy部署工具
  ☆28Updated 5 years ago
• Python3WebSpider / ElasticSearchTest
  Elastic Search Code
  ☆22Updated 3 years ago
• cyhleo / DaZongDianPing
  爬取大众点评中11205条厦门美食商铺信息，其中包含店名、人均消费、所属菜系、所属商圈、详细地址、口味评分、环境评分、服务评分信息。
  ☆19Updated 5 years ago
• shiqinying / AdslProxy
  自己搭建的adsl动态拨号代理池
  ☆14Updated 5 years ago
• Germey / JMeterMonitor
  JMeter Tester with Influxdb and Grafana
  ☆13Updated 5 years ago
• virjar / vscrawler
  a crawler framework appropriate grab
  ☆42Updated 6 years ago
• xiaowan / pyclient
  脚本类快速开发脚手架，集成了mysql/redis/rabbitmq/mongodb/elasticsearch，可快速进行业务开发
  ☆52Updated 6 years ago
• xsren / frontera-docs-zh_CN
  frontera的中文翻译文档
  ☆36Updated 7 years ago
• Larry0315 / QiYeWeChatApp
  基于企业微信中自建应用实现的报警平台/ChatOps平台
  ☆9Updated 6 years ago
• wx-chevalier / MachineLearning-Notes
  人工智能与深度学习实战 - 机器学习篇
  ☆10Updated 7 months ago
• solarhell / ZhihuZhuanlanCrawler
  知乎专栏爬虫
  ☆22Updated 3 years ago
• fanlw0816 / maoyan
  ☆14Updated 7 years ago
• simon-wind / realtime-analysis
  实时分析nginx日志，计算接口访问次数，uv，时延，异常IP等指标
  ☆28Updated 8 years ago
• Germey / Review_Reverse
  2019年末总结下今年做过的逆向，整理代码，复习思路。拼夕夕Web端anti_content参数逆向分析 WEB淘宝sign逆向分析；努比亚Cookie生成逆向分析；百度指数data加密逆向分析 今日头条WEB端_signature、as、cp参数逆向分析知乎登录formd…
  ☆47Updated 5 years ago
• accevolve / elk-easy-setup
  Easy to setup ELK Suite. (Elasticsearch / Logtash / Kibana)
  ☆92Updated 3 years ago
• usyiyi / sqlalchemy-docs-zh
  SqlAlchemy 1.1 中文文档（待校对）
  ☆11Updated 6 years ago
• analysys / Kong_Plus
  易观KongPlus
  ☆19Updated 2 years ago
• wx-chevalier / TensorFlow-Notes
  人工智能与深度学习实战 - TensorFlow 篇（MD & Notebooks）
  ☆13Updated 7 months ago
• Python3WebSpider / AjaxHookSpider
  Ajax Hook Demo
  ☆29Updated 4 years ago
• Light-City / dbSyncScheme
  数据库同步方案
  ☆42Updated 6 months ago
• edisonwd / hanlp-jupyterlab-docker
  一个集成jupyterlab编辑器的hanlp docker 镜像，并且使用github actions将镜像推送到自己的镜像仓库，便于快速体验hanlp
  ☆9Updated 4 years ago
• yeyeye777 / weixin_article_spider
  搜狗微信文章爬虫，对于临时链接进行转换为永久链接。
  ☆11Updated 4 years ago
• Ryuchen / DeadPool
  该项目是一个使用celery作为主体框架的爬虫应用，能够灵活的添加爬虫任务，并且同时运行多站点的爬虫工作，所有组件都能够原生支持规模并发和分布式，加上celery原生的分布式调用，实现大规模并发。
  ☆41Updated 2 years ago
• gtbotsonar / analyse-plugin-lua
  bot analyze openresty plugins
  ☆13Updated 5 years ago