Alternatives and similar repositories for crawl

Users that are interested in crawl are comparing it to the libraries listed below

• happyjared / python-learning
  Those years of learning Python - 这些年学习的Python
  ☆116Updated 5 years ago
• Northxw / Dianping
  大众点评店铺信息爬虫
  ☆286Updated 3 years ago
• duolaAOA / weibo_topic
  微博话题关键词,个人微博采集, 微博博文一键删除 selenium获取cookie,requests处理
  ☆32Updated 7 years ago
• Germey / Zhihu
  Zhihu User Spider
  ☆133Updated 6 years ago
• Python3WebSpider / Weibo
  Weibo Spider Using Scrapy
  ☆137Updated 7 years ago
• AlexTan-b-z / ZhihuSpider
  知乎分布式爬虫（Scrapy、Redis）
  ☆169Updated 7 years ago
• Python3WebSpider / Weixin
  Sougou Weixin Spider Using Proxy
  ☆87Updated 4 years ago
• Germey / Weibo
  Weibo Spider
  ☆49Updated 8 years ago
• zhangslob / Web-crawler-engineer-for-Python
  Web-crawler-engineer-for-Python
  ☆43Updated 7 years ago
• kong36088 / ZhihuSpider
  多线程知乎用户爬虫，基于python3
  ☆249Updated 2 years ago
• 15920036578 / JD_Spider
  京东爬虫（大量注释，对刚入门爬虫者极度友好）
  ☆71Updated 6 years ago
• Yanxueshan / Scrapy-Redis-Zhihu
  基于scrapy-redis实现分布式爬虫，爬取知乎所有问题及对应的回答，集成selenium模拟登录、英文验证码及倒立文字验证码识别、随机生成User-Agent、IP代理、处理302重定向问题等等
  ☆57Updated 6 years ago
• zhangslob / awesome_crawl
  腾讯新闻、知乎话题、微博粉丝，Tumblr爬虫、斗鱼弹幕、妹子图爬虫、分布式设计等
  ☆294Updated 3 weeks ago
• longxiaofei / dianping
  大众点评商家评论爬虫
  ☆48Updated 5 years ago
• bytebuff / ScrapingOutsourcing
  ScrapingOutsourcing专注分享爬虫代码 尽量每周更新一个
  ☆172Updated 5 years ago
• brady-chen / tbNews
  金融新闻增量式聚焦爬虫
  ☆21Updated 7 years ago
• leo8916 / wxhub
  微信公众号-文章-无限制抓取
  ☆157Updated 6 years ago
• Germey / TaobaoProduct
  Selenium Demo of Taobao Product
  ☆81Updated 6 years ago
• zhanghe06 / news_spider
  新闻抓取（微信、微博、头条...）
  ☆225Updated 2 years ago
• yokonsan / 163Music
  163music spider by scrapy.
  ☆61Updated 7 years ago
• TTyb / WechatPublic
  微信公众号的爬虫项目
  ☆35Updated 5 years ago
• ioiogoo / scrapy-monitor
  scrapy-monitor，实现爬虫可视化，监控实时状态
  ☆110Updated 8 years ago
• monkey-soft / Scrapy_IPProxyPool
  免费 IP 代理池。Scrapy 爬虫框架插件
  ☆103Updated 6 years ago
• haibincoder / ToutiaoCrawler
  今日头条爬虫，主要爬取关键词搜索结果，包含编辑距离算法、奇异值分解、k-means聚类。
  ☆72Updated 5 years ago
• kaito-kidd / douban-group-spider
  爬取豆瓣小组帖子的爬虫。
  ☆161Updated 2 years ago
• jin10086 / pachong
  一些爬虫的代码
  ☆147Updated 6 years ago
• ReainL / wechat
  微信好友男女比例，区域排名，签名情感分析
  ☆44Updated 6 years ago
• striver-ing / distributed-spider
  通用新闻类网站分布式爬虫
  ☆77Updated 6 years ago
• heqin-zhu / dbworld-search
  简单的搜索引擎, django 框架
  ☆46Updated 6 years ago
• qinyuenlp / WeiboSpider
  基于selenium的轻量级新浪微博爬虫，可实现：1.后台自动爬取微博搜索结果/2.按时间段爬取搜索结果/3.爬取用户基本信息
  ☆51Updated 5 years ago