Alternatives and similar repositories for webcrawler

Users that are interested in webcrawler are comparing it to the libraries listed below

• Germey / Zhihu
  Zhihu User Spider
  ☆134Updated 6 years ago
• jin10086 / pachong
  一些爬虫的代码
  ☆147Updated 6 years ago
• changetjut / ProxySpider
  爬取http://www.xicidaili.com/上代理IP，并验证代理可用性
  ☆143Updated 5 years ago
• wzyonggege / Mzitu-Crawler
  ☆68Updated 7 years ago
• gzm1997 / wxImage
  ☆92Updated 7 years ago
• luyishisi / Nyspider
  各种爬虫---大众点评,安居客，58，人人贷，拍拍贷, IT桔子,拉勾网，豆瓣,搜房网,ASO100,气象数据,猫眼电影,链家,PM25.in...
  ☆196Updated 8 years ago
• thsheep / mzitu_scrapy
  基于Scrapy的www.mzitu.com的全站图片下载脚本
  ☆71Updated 6 years ago
• wzyonggege / Zhihu-Crawler
  知乎网爬虫
  ☆21Updated 8 years ago
• xiaosimao / AiSpider
  爬虫轻型框架
  ☆231Updated 7 years ago
• kulovecc / jandan_spider
  使用Python3爬取煎蛋图片
  ☆178Updated 5 years ago
• l-passer / Passer-zhihu
  用Python看知乎
  ☆175Updated 8 years ago
• moranzcw / Zhihu-Spider
  一个获取知乎用户主页信息的多线程Python爬虫程序。
  ☆139Updated 6 years ago
• AlexTan-b-z / ZhihuSpider
  知乎分布式爬虫（Scrapy、Redis）
  ☆169Updated 7 years ago
• PyCN / pythoncn-projects
  加入Python中文社区GitHub项目组
  ☆184Updated 3 years ago
• facert / tumblr_spider
  汤不热 python 多线程爬虫
  ☆463Updated 4 years ago
• Rockyzsu / zhihuToKindle
  模拟登陆知乎，获取关注问题的id下 所有答案，并推送到kindle电子书
  ☆146Updated 5 years ago
• Qutan / Spider
  社交数据爬虫
  ☆218Updated 8 years ago
• Germey / TouTiao
  TouTiao Spider Demo
  ☆177Updated 6 years ago
• LiuXingMing / Tmall1212
  天猫双12爬虫，附商品数据。
  ☆199Updated 8 years ago
• Germey / MaoYan
  MaoYan Top100 Spider
  ☆61Updated 5 years ago
• Germey / TaobaoProduct
  Selenium Demo of Taobao Product
  ☆81Updated 6 years ago
• chengyumeng / spider163
  抓取网易云音乐热门评论
  ☆577Updated 2 years ago
• zhangslob / Python-General-Spider-
  A spider for Python
  ☆18Updated 7 years ago
• elliotxx / zhihu-crawler-people
  A simple distributed crawler for zhihu && data analysis
  ☆192Updated 2 years ago
• StephinChou / Pythonspider
  一个简单的python爬虫，原生python+BeautifulSoup
  ☆157Updated 6 years ago
• daili0015 / Download_1024
  Python project, to download resource from 1024.
  ☆94Updated 8 years ago
• yjm12321 / zhihu-girl
  抓取知乎妹子头像
  ☆111Updated 9 years ago
• liuslnlp / crawler_examples
  Some classic web crawler projects.一些经典的爬虫
  ☆77Updated 5 years ago
• SpiderClub / smart_login
  各大网站登陆方式，有的是通过selenium登录，有的是通过抓包直接模拟登录（精力原因，目前不再继续维护）
  ☆1,013Updated 2 years ago
• Tachone / zhihu_spider
  large-scale user information crawler of zhihu
  ☆77Updated 8 years ago