Alternatives and similar repositories for multithread-crawler:

Users that are interested in multithread-crawler are comparing it to the libraries listed below

• SaberAlexander / Distributed
  an instant to crawl JD data in the way of distributed docker.
  ☆19Updated 7 years ago
• shuizhengqi1 / MaiMaiSpider
  ☆14Updated 7 years ago
• AoboJaing / thirdDemo
  python3 scrapy crawler crawl taobao.com, data import to MySQL
  ☆21Updated 8 years ago
• da2vin / Spider_index
  爬取百度指数和阿里指数，采用selenium，存入hbase，验证码自动识别，多线程控制
  ☆32Updated 8 years ago
• PyCN / lagou_spider
  拉勾网爬虫, 利用通过微信公众号推送数据
  ☆8Updated 8 years ago
• wanghuafeng / baidu_spider
  百度爬虫：热词，词频，音乐，poi信息
  ☆22Updated 9 years ago
• iamGavinZhou / py-captcha-breaking
  破解验证码的完整演示程序，just for demo!
  ☆51Updated 8 years ago
• wwj718 / ibot
  为命令行火车票查询器添加自然语言交互界面
  ☆60Updated 8 years ago
• miaofu / WebDataProduct
  A Web Page Of Public Sentiment For P2P Industry( P2P 行业的舆情分析前端展示)
  ☆25Updated 8 years ago
• weizetao / spider-roach
  分布式定向抓取集群
  ☆71Updated 7 years ago
• hexcola / wcspider
  微信公众号爬虫
  ☆42Updated 8 years ago
• liuwons / green
  微信公众号源码 - 微信号Ms_haoqi
  ☆62Updated last year
• backto17 / SinaHouseCrawler
  基于scrapy,scrapy-redis实现的一个分布式网络爬虫,爬取了新浪房产的楼盘信息及户型图片,实现了常用的爬虫功能需求.
  ☆40Updated 8 years ago
• ziwang-com / zwpy_lst
  中文版的python常用模块库清单,是zwPython项目的一部分,源自目前最常用的python第三方模块库清单：awesome-python的基础上
  ☆68Updated 9 years ago
• wanghuafeng / e-business
  电商爬虫系统：京东，当当，一号店，国美爬虫（代理使用）；论坛、新闻、豆瓣爬虫
  ☆105Updated 6 years ago
• dingyaguang117 / ImageRecognizeOf58
  58同城图片验证码识别
  ☆57Updated 9 years ago
• bowenpay / weibo-spider
  微博爬虫。通过调用weibo api，而非暴力爬取的方式获取信息。
  ☆32Updated 8 years ago
• lcdevelop / weixin-crawler
  微信公众号批量抓取器
  ☆55Updated 8 years ago
• fendouai / BossComing
  If your boss is coming ,send your phone a notification, based on face_recognition for face recognition and JPush to send notification.Jus…
  ☆79Updated 4 years ago
• yanshengli / sina_weibo_crawler
  利用urllib2加beautifulsoup爬取新浪微博
  ☆69Updated 9 years ago
• armysheng / tech163newsSpider
  爬取网易新闻，存储到本地的mongodb
  ☆42Updated 10 years ago
• ToonoW / SpiderManager
  爬虫管理平台
  ☆31Updated 2 years ago
• awolfly9 / job_wxbot
  微信机器人抓取并分发招聘信息
  ☆25Updated 7 years ago
• xiaobeibei26 / weixin_spider
  微信文章爬虫，加入代理池中间件
  ☆17Updated 7 years ago
• url2io / url2io-python-sdk
  ⛔ [DEPRECATED] URL2io Python SDK，用于网页信息提取，如正文提取
  ☆41Updated 4 years ago
• Alihanniba / wechat_articles_spider
  A Spider About Wechat Articles 、Official Accounts
  ☆28Updated 2 years ago
• PyCN / Ugly-Distributed-Crawler
  基于Redis实现的简单到爆的分布式爬虫
  ☆14Updated 7 years ago
• handalin / CharlieLrc
  查理歌词, 一个微信公众帐号, 1.0版本. 暂时可以实现快速查找歌词.
  ☆67Updated 10 years ago
• jhao104 / spider
  python crawler spider
  ☆71Updated 7 years ago
• younghz / scrapy-redis
  Redis-based components for scrapy that allows distributed crawling
  ☆46Updated 10 years ago