Alternatives and similar repositories for multithread-crawler

Users that are interested in multithread-crawler are comparing it to the libraries listed below

• SaberAlexander / Distributed
  an instant to crawl JD data in the way of distributed docker.
  ☆19Updated 7 years ago
• shuizhengqi1 / MaiMaiSpider
  ☆14Updated 7 years ago
• da2vin / Spider_index
  爬取百度指数和阿里指数，采用selenium，存入hbase，验证码自动识别，多线程控制
  ☆32Updated 8 years ago
• AoboJaing / thirdDemo
  python3 scrapy crawler crawl taobao.com, data import to MySQL
  ☆21Updated 8 years ago
• awolfly9 / job_wxbot
  微信机器人抓取并分发招聘信息
  ☆25Updated 8 years ago
• taozhijiang / readmeinfo
  Feed news reader including recommend schema
  ☆29Updated 8 years ago
• armysheng / tech163newsSpider
  爬取网易新闻，存储到本地的mongodb
  ☆42Updated 10 years ago
• tianshuang / pull-readhub
  Pull news from https://readhub.cn/ and push to dingtalk
  ☆13Updated 2 years ago
• LiuRoy / spider_docker
  为爬虫引用创建container，包括的模块：scrapy, mongo, celery, rabbitmq
  ☆37Updated 9 years ago
• hexcola / wcspider
  微信公众号爬虫
  ☆42Updated 8 years ago
• LiuXingMing / captcha_identify
  提供验证码识别接口
  ☆12Updated 6 years ago
• LKI / wescraper
  依赖Scrapy和搜狗搜索微信公众号文章
  ☆46Updated 8 years ago
• bowenpay / weibo-spider
  微博爬虫。通过调用weibo api，而非暴力爬取的方式获取信息。
  ☆32Updated 8 years ago
• iamGavinZhou / py-captcha-breaking
  破解验证码的完整演示程序，just for demo!
  ☆51Updated 8 years ago
• wwj718 / ibot
  为命令行火车票查询器添加自然语言交互界面
  ☆60Updated 8 years ago
• pkuanjie / Wechat_AutoJump
  自动玩微信小游戏跳一跳
  ☆84Updated 7 years ago
• PyCN / lagou_spider
  拉勾网爬虫, 利用通过微信公众号推送数据
  ☆8Updated 8 years ago
• LiuRoy / parker
  ☆65Updated 8 years ago
• wwj718 / jobSpider
  jobSpider是一只scrapy爬虫，用于爬取职位信息
  ☆27Updated 8 years ago
• wanghuafeng / baidu_spider
  百度爬虫：热词，词频，音乐，poi信息
  ☆22Updated 10 years ago
• wanghuafeng / e-business
  电商爬虫系统：京东，当当，一号店，国美爬虫（代理使用）；论坛、新闻、豆瓣爬虫
  ☆106Updated 7 years ago
• 521xueweihan / PySpider
  Python爬虫的学习历程
  ☆52Updated 7 years ago
• hailong0707-zz / spider_news_finance
  Scrapy Spider for SinaFinance, FTChinese, CFI.
  ☆22Updated 10 years ago
• Alihanniba / wechat_articles_spider
  A Spider About Wechat Articles 、Official Accounts
  ☆28Updated 2 years ago
• ClericPy / EC-Spider
  Obsolete 已废弃.
  ☆86Updated 8 years ago
• ciknight / wbot
  Deprecated，https://github.com/PY-Learning/wbot
  ☆11Updated 8 years ago
• younghz / scrapy-redis
  Redis-based components for scrapy that allows distributed crawling
  ☆46Updated 10 years ago
• dingyaguang117 / ImageRecognizeOf58
  58同城图片验证码识别
  ☆57Updated 9 years ago
• shelmesky / crawler
  淘宝爬虫原型，基于gevent
  ☆49Updated 11 years ago
• hk029 / LagouSpider
  【图文详解】scrapy爬虫与动态页面——爬取拉勾网职位信息（1）
  ☆82Updated 8 years ago