Alternatives and similar repositories for crawl:

Users that are interested in crawl are comparing it to the libraries listed below

• Germey / Zhihu
  Zhihu User Spider
  ☆133Updated 6 years ago
• Germey / TaobaoProduct
  Selenium Demo of Taobao Product
  ☆81Updated 6 years ago
• kong36088 / ZhihuSpider
  多线程知乎用户爬虫，基于python3
  ☆244Updated last year
• Germey / Weibo
  Weibo Spider
  ☆48Updated 7 years ago
• xqtbox / AutoHomeSpider_Scrapy
  爬取汽车之家的口碑数据，并破解前端js反爬虫措施分析
  ☆62Updated 7 years ago
• Germey / MaoYan
  MaoYan Top100 Spider
  ☆61Updated 5 years ago
• zhanghe06 / news_spider
  新闻抓取（微信、微博、头条...）
  ☆221Updated 2 years ago
• Hopetree / Jobs-search
  招聘网站爬虫合集，不定期更新分支
  ☆135Updated 7 years ago
• AlexTan-b-z / ZhihuSpider
  知乎分布式爬虫（Scrapy、Redis）
  ☆168Updated 7 years ago
• duolaAOA / weibo_topic
  微博话题关键词,个人微博采集, 微博博文一键删除 selenium获取cookie,requests处理
  ☆31Updated 6 years ago
• dangsh / hive
  lots of spider (很多爬虫）
  ☆118Updated 6 years ago
• monkey-soft / Scrapy_IPProxyPool
  免费 IP 代理池。Scrapy 爬虫框架插件
  ☆102Updated 6 years ago
• Germey / TouTiao
  TouTiao Spider Demo
  ☆176Updated 5 years ago
• Tim9Liu9 / python_spider_jobs
  python写的爬虫，爬取51job前程无忧、智联招聘的大城市（北京、上海、深圳、广州、杭州、成都、武汉、长沙、珠海）各种编程岗位的职位数。
  ☆98Updated 6 years ago
• yokonsan / dingdian
  Python爬虫和Flask实现小说网站
  ☆124Updated 6 years ago
• happyjared / python-learning
  Those years of learning Python - 这些年学习的Python
  ☆114Updated 5 years ago
• jin10086 / pachong
  一些爬虫的代码
  ☆147Updated 6 years ago
• Qutan / Spider
  社交数据爬虫
  ☆215Updated 8 years ago
• Yanxueshan / Scrapy-Redis-Zhihu
  基于scrapy-redis实现分布式爬虫，爬取知乎所有问题及对应的回答，集成selenium模拟登录、英文验证码及倒立文字验证码识别、随机生成User-Agent、IP代理、处理302重定向问题等等
  ☆56Updated 5 years ago
• longxiaofei / dianping
  大众点评商家评论爬虫
  ☆47Updated 5 years ago
• pythonsite / spider
  爬虫
  ☆76Updated 7 years ago
• yokonsan / 163Music
  163music spider by scrapy.
  ☆60Updated 7 years ago
• 15920036578 / JD_Spider
  京东爬虫（大量注释，对刚入门爬虫者极度友好）
  ☆71Updated 5 years ago
• xiaosimao / AiSpider
  爬虫轻型框架
  ☆230Updated 6 years ago
• moranzcw / Zhihu-Spider
  一个获取知乎用户主页信息的多线程Python爬虫程序。
  ☆139Updated 6 years ago
• Python3WebSpider / Weibo
  Weibo Spider Using Scrapy
  ☆137Updated 7 years ago
• zhouwei713 / weibo_spider
  微博内容及评论自动爬取
  ☆45Updated 4 years ago
• speng4096 / PyLoom
  Python爬虫框架，内置微博、自如、豆瓣图书、拉勾网、拼多多等爬虫
  ☆247Updated 5 years ago
• haibincoder / ToutiaoCrawler
  今日头条爬虫，主要爬取关键词搜索结果，包含编辑距离算法、奇异值分解、k-means聚类。
  ☆71Updated 5 years ago
• starFalll / Spider
  新浪微博爬虫(Sina weibo spider)，百度搜索结果 爬虫
  ☆194Updated last year