Alternatives and similar repositories for crawlers

Users that are interested in crawlers are comparing it to the libraries listed below

• dongweiming / commentbox
  网易云音乐精彩评论[关闭]
  ☆253Updated 8 years ago
• manning23 / MSpider
  Spider
  ☆347Updated 2 years ago
• SmileXie / zhihu_crawler
  Crawler of zhihu.com
  ☆269Updated 8 years ago
• awolfly9 / jd_analysis
  京东商城评价信息数据分析。查看示例：http://awolfly9.com/article/jd_comment_analysis
  ☆254Updated 8 years ago
• leitro / knowsecSpider2
  知道创宇爬虫题目 持续更新版本
  ☆94Updated 10 years ago
• protream / iquery
  Various information query via command line.
  ☆703Updated 7 years ago
• x2c3z4 / wechat-sendall
  给好友群发有诚意的消息喔
  ☆227Updated 9 years ago
• wuchangfeng / vino-crawlers
  Some crawlers for getting data from the net.
  ☆209Updated 8 years ago
• Huangtuzhi / top-topic-Zhihu
  Display top 10 topics on Zhihu everday.
  ☆168Updated 9 years ago
• zrools / spider
  ☆113Updated 9 years ago
• gnemoug / sina_reptile
  获取新浪微博1000w用户的基本信息和每个爬取用户最近发表的50条微博,使用python编写，多进程爬取，将数据存储在了mongodb中
  ☆472Updated 12 years ago
• AnyISalIn / zhihu_fun
  基于 Selenium 的知乎关键词爬虫
  ☆185Updated 7 years ago
• gavin66 / proxy_list
  爬取免费可用代理，供爬虫等工具使用
  ☆589Updated 6 years ago
• lucasxlu / LagouJob
  Data Analysis & Mining for lagou.com
  ☆263Updated 6 years ago
• yjm12321 / zhihu-girl
  抓取知乎妹子头像
  ☆111Updated 9 years ago
• taizilongxu / douban.fm
  douban.fm based on Python
  ☆784Updated 6 years ago
• phith0n / Minos
  一个基于Tornado/mongodb/redis的社区系统。
  ☆674Updated 5 years ago
• shell909090 / learn-python
  开放式的Python课程
  ☆155Updated 5 years ago
• woolabs / Woobuntu
  ☆244Updated 7 years ago
• eastrd / HighAnonProxyPool
  A proxy pool that scrapes free anonymous proxies and maintains its proxies' availability.
  ☆93Updated 7 years ago
• LiuRoy / huatian-funny
  科学地分析自己的择偶观
  ☆241Updated 9 years ago
• zhangchenchen / proxyspider
  代理IP 采集程序
  ☆263Updated 7 years ago
• FullerHua / gooseeker
  ☆699Updated 8 years ago
• littlecodersh / MyPlatform
  文科生也会配的微信个人号后台，Content based wechat massive platform framework, what you need to do is only adding your articles in :)
  ☆138Updated 8 years ago
• ladingwu / python_zhihu
  一个知乎爬虫，登陆，获取答案，图片
  ☆309Updated 4 years ago
• facert / tumblr_spider
  汤不热 python 多线程爬虫
  ☆461Updated 4 years ago
• xiaoyu2er / google-mirror-check
  谷歌镜像搜集+检测
  ☆119Updated 8 years ago
• Alexis374 / tech_post
  record the technique and thinking when I am coding and learning
  ☆282Updated 8 years ago
• yijingping / unicrawler
  一个通用的可配置的爬虫框架
  ☆541Updated 2 years ago
• chensoul / scrapy-zhihu-github
  scrapy examples for crawling zhihu and github
  ☆224Updated 2 years ago