Alternatives and similar repositories for scrapy

Users that are interested in scrapy are comparing it to the libraries listed below

• Jaysong2012 / tutorial
  Scrapy爬虫实战系列，从零开始爬取腾讯百度淘宝知乎各大网站内容 \n 12306刷票脚本系列
  ☆82Updated 6 years ago
• facert / scrapy_helper
  Dynamic configurable crawl (动态可配置化爬虫)
  ☆87Updated 7 years ago
• yyyy777 / crawler
  python爬虫练习
  ☆111Updated 6 years ago
• wanghuafeng / e-business
  电商爬虫系统：京东，当当，一号店，国美爬虫（代理使用）；论坛、新闻、豆瓣爬虫
  ☆106Updated 7 years ago
• qqxx6661 / scrapy-yzd
  该项目为scrapy框架脚手架，整合了自动切换agent，自动切换代理ip等中间件，可以下载后自行编写爬虫。 支持： 豆瓣电影，某东商品信息（名称价格等）。
  ☆35Updated 6 years ago
• SteelZheng / python-get-girl-image
  Python爬虫，抓取“mzitu.com”网站上的美女图片。支持将单一界面的多相册下的图片下载到本地。用到第三方库BeautifulSoup、request
  ☆85Updated 8 years ago
• bowenpay / weibo-spider
  微博爬虫。通过调用weibo api，而非暴力爬取的方式获取信息。
  ☆32Updated 8 years ago
• nolanzhao / FutureNews
  新闻聚合网站，抓取科技圈主流媒体报道的即将发生的事
  ☆59Updated 2 years ago
• url2io / url2io-python-sdk
  ⛔ [DEPRECATED] URL2io Python SDK，用于网页信息提取，如正文提取
  ☆41Updated 4 years ago
• ioiogoo / scrapy-monitor
  scrapy-monitor，实现爬虫可视化，监控实时状态
  ☆110Updated 8 years ago
• hackfengJam / ArticleSpider
  Crawling zhihu, jobbole, lagou by Scrapy, and using Elasticsearch+Django to build a Search Engine website --- README_zh.md (including: i…
  ☆38Updated 6 years ago
• xiaosimao / wx_code
  公众号文章代码
  ☆62Updated 6 years ago
• SentDz / BaiduYunSpider2017
  百度网盘爬虫2017
  ☆19Updated 8 years ago
• Python3WebSpider / ProxySettings
  Proxy Settings
  ☆41Updated 7 years ago
• Germey / MaoYan
  MaoYan Top100 Spider
  ☆61Updated 5 years ago
• Henryhaohao / DouYin_Video
  DouYin_Video抖音APP视频下载
  ☆31Updated 6 years ago
• Python3WebSpider / Weixin
  Sougou Weixin Spider Using Proxy
  ☆87Updated 4 years ago
• chifeng111 / taobao
  淘宝商品信息爬取
  ☆12Updated 7 years ago
• Tim9Liu9 / python_spider_jobs
  python写的爬虫，爬取51job前程无忧、智联招聘的大城市（北京、上海、深圳、广州、杭州、成都、武汉、长沙、珠海）各种编程岗位的职位数。
  ☆100Updated 6 years ago
• lb2281075105 / LBDuoDian
  ☆21Updated 4 years ago
• zhangslob / Taobao_duoshou
  使用Scrapy采集淘宝数据，Flask展示
  ☆66Updated 7 years ago
• FWC1994 / Python-Crawler
  python多线程爬虫爬取电影天堂资源
  ☆93Updated 4 years ago
• Germey / TaobaoProduct
  Selenium Demo of Taobao Product
  ☆81Updated 6 years ago
• csurong / Manyuewan
  flask + 爬虫 = 小说 + 漫画
  ☆33Updated 2 years ago
• HITFRobot / happy-spiders
  🔧 🔩 🔨 收集整理了爬虫相关的工具、模拟登陆技术、代理IP、scrapy模板代码等内容。
  ☆267Updated 6 years ago
• AaronJny / mm_taobao
  抓取淘女郎图片的简单爬虫，对应博文[python爬虫入门教程(三)：淘女郎爬虫 ( 接口解析 | 图片下载 )](https://blog.csdn.net/aaronjny/article/details/80291997)。
  ☆11Updated 7 years ago
• ErisYoung / douyin_spider
  🎨One simple and easy to use crawler for DouYin（一个简单易用的抖音爬虫,可下载指定用户,挑战,音乐的视频,音频和数据)
  ☆67Updated 5 years ago
• xingag / weixin_spider
  爬取微信公众号文章
  ☆28Updated 6 years ago
• littlepai / Unofficial-Zhihu-API
  深度学习模型自动识别验证码，python爬虫库自动管理会话，通过简单易用的API，实现知乎数据的爬取
  ☆77Updated 2 years ago
• JosephPai / 1024Video-Crawler
  A python crawler for 1024 jap video from a mystery website. (No url)
  ☆58Updated 7 years ago