Alternatives and similar repositories for awesome-spider:

Users that are interested in awesome-spider are comparing it to the libraries listed below

• sunnotes / Ali-Data-Mining
  阿里巴巴大数据竞赛
  ☆62Updated 10 years ago
• AoboJaing / thirdDemo
  python3 scrapy crawler crawl taobao.com, data import to MySQL
  ☆21Updated 8 years ago
• evanleungc / GoldSentAnalysis
  黄金舆情数据分析
  ☆46Updated 7 years ago
• ppy2790 / dianpingshop
  大众点评商户数据爬虫
  ☆111Updated 8 years ago
• da2vin / Spider_index
  爬取百度指数和阿里指数，采用selenium，存入hbase，验证码自动识别，多线程控制
  ☆32Updated 8 years ago
• zhangslob / Taobao_duoshou
  使用Scrapy采集淘宝数据，Flask展示
  ☆65Updated 6 years ago
• wwj718 / jobSpider
  jobSpider是一只scrapy爬虫，用于爬取职位信息
  ☆27Updated 8 years ago
• wanghuafeng / e-business
  电商爬虫系统：京东，当当，一号店，国美爬虫（代理使用）；论坛、新闻、豆瓣爬虫
  ☆104Updated 6 years ago
• xqtbox / AutoHomeSpider_Scrapy
  爬取汽车之家的口碑数据，并破解前端js反爬虫措施分析
  ☆62Updated 7 years ago
• tomoncle / Python-notes
  Python related technologies used in work: crawler, data analysis, timing tasks, RPC, page parsing, decorator, built-in functions, Python …
  ☆102Updated 5 years ago
• wanghuafeng / baidu_spider
  百度爬虫：热词，词频，音乐，poi信息
  ☆22Updated 9 years ago
• liaolongfei / lagou
  拉勾网Python职位数据分析
  ☆12Updated 6 years ago
• alicelmx / wechat_public_spider
  通过搜狗搜索引擎爬取微信公众号文章
  ☆28Updated 7 years ago
• vbay / MusicRecommender
  基于Spark MLlib ALS的音乐推荐系统
  ☆29Updated 8 years ago
• hailong0707-zz / spider_news_all
  Scrapy Spider for 各种新闻网站
  ☆107Updated 9 years ago
• BladeMasterCoder / KaggleCTR
  数据挖掘，参加Kaggle的一个预测广告点击率的竞赛
  ☆28Updated 9 years ago
• 521xueweihan / PySpider
  Python爬虫的学习历程
  ☆51Updated 7 years ago
• LiuXingMing / Tmall1212
  天猫双12爬虫，附商品数据。
  ☆199Updated 8 years ago
• TongzheZhang / DF-competition-sogou
  大数据精准营销中搜狗用户画像挖掘
  ☆36Updated 8 years ago
• widy28 / scrapy-taobao
  scrapy模拟淘宝登陆
  ☆74Updated 4 years ago
• lcdevelop / weixin-crawler
  微信公众号批量抓取器
  ☆55Updated 8 years ago
• younghz / TBBKAnalysis
  关于淘宝“爆款”数据爬取与分析。具体分析见 —
  ☆184Updated 6 years ago
• felixglow / Tianyancha
  scrapy 爬取tianyancha网站的 公司注册信息
  ☆3Updated 5 years ago
• hk029 / LagouSpider
  【图文详解】scrapy爬虫与动态页面——爬取拉勾网职位信息（1）
  ☆82Updated 8 years ago
• zkqiang / job-spider
  多线程爬取互联网行业常用招聘网站
  ☆29Updated 6 years ago
• pujinxiao / wechat_sogou_crawl
  基于搜狗微信的公众号文章爬虫
  ☆25Updated 7 years ago
• kong36088 / ZhihuAnalyse
  知乎用户爬虫数据分析
  ☆15Updated 7 years ago
• boss-mao / scrapy_enterprise_architecture
  python scrapy 企业级分布式爬虫开发架构模板
  ☆93Updated 6 years ago
• miaofu / WebDataProduct
  A Web Page Of Public Sentiment For P2P Industry( P2P 行业的舆情分析前端展示)
  ☆25Updated 8 years ago
• PENGZhaoqing / scrapy-HousePricing
  A data extraction tool for HousePricing(https://github.com/PENGZhaoqing/HousePricing)
  ☆51Updated 8 years ago