Alternatives and similar repositories for Crawler

Users that are interested in Crawler are comparing it to the libraries listed below

• jin10086 / pachong
  一些爬虫的代码
  ☆147Updated 6 years ago
• Karmenzind / fp-server
  Free proxy server, continuously crawling and providing proxies, based on Tornado and Scrapy. 免费代理服务器，基于Tornado和Scrapy，在本地搭建属于自己的代理池
  ☆159Updated 2 years ago
• Ehco1996 / lazySpider
  爬虫的各种坑 我来填 :)
  ☆67Updated 5 years ago
• jhao104 / spider
  python crawler spider
  ☆71Updated 8 years ago
• howie6879 / hproxy
  hproxy - Asynchronous IP proxy pool, aims to make getting proxy as convenient as possible.(异步爬虫代理池)
  ☆66Updated 3 years ago
• moranzcw / Zhihu-Spider
  一个获取知乎用户主页信息的多线程Python爬虫程序。
  ☆139Updated 6 years ago
• rieuse / DouyuTV
  DouyuTV弹幕，房间信息爬取，数据分析
  ☆79Updated 4 years ago
• AlexTan-b-z / ZhihuSpider
  知乎分布式爬虫（Scrapy、Redis）
  ☆169Updated 7 years ago
• url2io / url2io-python-sdk
  ⛔ [DEPRECATED] URL2io Python SDK，用于网页信息提取，如正文提取
  ☆41Updated 4 years ago
• Lodour / Weibo-Album-Crawler
  A multiprocessing crawler for weibo albums.
  ☆99Updated 3 years ago
• dengqiangxi / zhihu_spider
  知乎爬虫，用于爬取用户信息以及用户之间关系。
  ☆33Updated 2 years ago
• nanxung / QQ_zone
  QQ空间爬虫，一小时20万数据
  ☆86Updated 6 years ago
• BruceDone / scrapy_demo
  all kinds of scrapy demo
  ☆165Updated 2 years ago
• kong36088 / ZhihuSpider
  多线程知乎用户爬虫，基于python3
  ☆249Updated 2 years ago
• ShichaoMa / structure_spider
  组合多请求，抓取结构化数据，基于scrapy组件
  ☆29Updated 2 years ago
• cwjokaka / bilibili_member_crawler
  B站用户爬虫 好耶~是爬虫
  ☆147Updated 2 years ago
• Germey / Weibo
  Weibo Spider
  ☆49Updated 8 years ago
• howie6879 / owllook_gui
  简洁优雅的小说监控工具🎉
  ☆89Updated 7 years ago
• bowenpay / weibo-spider
  微博爬虫。通过调用weibo api，而非暴力爬取的方式获取信息。
  ☆32Updated 8 years ago
• staugur / grab_huaban_board
  这是Python版花瓣网爬虫，js版用户脚本请访问https://github.com/staugur/userscript
  ☆44Updated 4 years ago
• build2last / NCspider
  A Scrapy Project 中文门户网站新闻和评论抓取——重启维护工作
  ☆14Updated 2 years ago
• hailong0707-zz / spider_news_all
  Scrapy Spider for 各种新闻网站
  ☆109Updated 9 years ago
• xiaoquantou / jd_spider
  京东爬虫，可抓取京东商品信息和评论
  ☆261Updated 7 years ago
• liuslnlp / crawler_examples
  Some classic web crawler projects.一些经典的爬虫
  ☆77Updated 5 years ago
• Hopetree / Scrapy-Tieba
  百度贴吧Scrapy爬虫，附简单可视化分析
  ☆39Updated 7 years ago
• zhangslob / Web-crawler-engineer-for-Python
  Web-crawler-engineer-for-Python
  ☆43Updated 7 years ago
• yokonsan / 163Music
  163music spider by scrapy.
  ☆61Updated 7 years ago
• littlecodersh / NetEaseMusicApi
  完善的网易云音乐Api
  ☆129Updated 8 years ago
• billvsme / videoSpider
  抓取豆瓣，bilibili等中的电视剧、电影、动漫演员等信息
  ☆227Updated 3 years ago
• howie6879 / talospider
  talospider - A simple,lightweight scraping micro-framework
  ☆55Updated 6 years ago