Alternatives and similar repositories for multithreading-spider

Users that are interested in multithreading-spider are comparing it to the libraries listed below

• A1014280203 / Ugly-Distributed-Crawler
  基于Redis实现的简单到爆的分布式爬虫
  ☆45Updated 8 years ago
• howie6879 / hproxy
  hproxy - Asynchronous IP proxy pool, aims to make getting proxy as convenient as possible.(异步爬虫代理池)
  ☆66Updated 4 years ago
• awolfly9 / job_wxbot
  微信机器人抓取并分发招聘信息
  ☆25Updated 8 years ago
• howie6879 / talospider
  talospider - A simple,lightweight scraping micro-framework
  ☆55Updated 6 years ago
• Rockyzsu / getProxy
  爬虫获取http://www.xicidaili.com/ 代理服务器
  ☆82Updated 8 years ago
• jiehua233 / ipproxy
  代理IP提取工具
  ☆115Updated 8 years ago
• xiaodaguan / sogou_weixin
  weixin.sogou.com 微信爬虫 -- 基于scrapy
  ☆28Updated 9 years ago
• dongweiming / mp
  微信公众号文章代码库
  ☆88Updated 2 years ago
• Germey / AdslProxy
  ☆17Updated 8 years ago
• qiaofei32 / yunCrawler
  智能云爬虫Demo
  ☆32Updated 8 years ago
• awolfly9 / jd_comment
  分布式抓取京东商品的评价信息
  ☆28Updated 8 years ago
• h01 / ProxyScanner
  python HTTP代理扫描
  ☆125Updated 11 years ago
• conwaywang / jiemeibang
  python实现采集数据并发表到论坛中。涉及数据的爬取分析，discuz论坛的登录、发帖及回复等
  ☆40Updated 12 years ago
• Ehco1996 / lazySpider
  爬虫的各种坑 我来填 :)
  ☆65Updated 6 years ago
• woniu127 / domain
  查询域名是否注册以及获取域名whois
  ☆50Updated 6 years ago
• mapleray / proxy_pool
  python 代理池
  ☆103Updated 9 years ago
• wuchong / scrapy-dynamic-configurable
  A dynamic configurable news crawler based Scrapy
  ☆165Updated 8 years ago
• Germey / TaobaoMM
  WebSpider of TaobaoMM developed by PySpider
  ☆108Updated 9 years ago
• hustcc / wrapcache
  A python Function / Method OUTPUT cache system base on function Decorators.
  ☆57Updated 5 years ago
• qiyeboy / baidulogin
  百度登录加密协议分析，以及登录实现
  ☆135Updated 9 years ago
• 2shou / PhantomjsFetcher
  A python web fetcher using phantomjs to mock browser
  ☆180Updated 8 years ago
• KDF5000 / RSpider
  一个基于scrapy-redis的分布式爬虫模板
  ☆43Updated 8 years ago
• abuyun / proxy-demo
  abuyun cloud proxy demo
  ☆66Updated last year
• shelmesky / crawler
  淘宝爬虫原型，基于gevent
  ☆48Updated 12 years ago
• adrian9631 / CrawlerMonitor
  爬虫监控及可视化 ( Prometheus and Grafana ) Building a crawler with distributed task queues (Celery) and fetching data with a reliable monitor sy…
  ☆44Updated 3 years ago
• cw1997 / get-email-by-tieba
  用于抓取贴吧发帖中的手机号和电子邮箱的一个爬虫
  ☆63Updated 8 years ago
• intohole / xspider
  easy crawl web resource , extract web infomation/简单的爬虫框架
  ☆64Updated 3 years ago
• jinhang / 12306_captcha
  CNN对12306、sina、baidu的验证码破解。
  ☆96Updated 9 years ago
• mazzzystar / BaiduCrawler
  Sample of using proxies to crawl baidu search results.
  ☆118Updated 7 years ago
• BruceDone / cnbeta
  一键抓取cnbeta 首页的所有消息
  ☆16Updated 9 years ago