Alternatives and similar repositories for crawlers:

Users that are interested in crawlers are comparing it to the libraries listed below

• dongweiming / commentbox
  网易云音乐精彩评论[关闭]
  ☆253Updated 8 years ago
• protream / iquery
  Various information query via command line.
  ☆703Updated 7 years ago
• awolfly9 / jd_analysis
  京东商城评价信息数据分析。查看示例：http://awolfly9.com/article/jd_comment_analysis
  ☆254Updated 7 years ago
• manning23 / MSpider
  Spider
  ☆347Updated 2 years ago
• littlecodersh / MyPlatform
  文科生也会配的微信个人号后台，Content based wechat massive platform framework, what you need to do is only adding your articles in :)
  ☆138Updated 8 years ago
• dongweiming / Mtime
  A spider... ^.^
  ☆99Updated 11 years ago
• phith0n / Minos
  一个基于Tornado/mongodb/redis的社区系统。
  ☆673Updated 5 years ago
• x2c3z4 / wechat-sendall
  给好友群发有诚意的消息喔
  ☆227Updated 9 years ago
• leitro / knowsecSpider2
  知道创宇爬虫题目 持续更新版本
  ☆95Updated 10 years ago
• iamyaojie / Spider
  Wandering Spider
  ☆237Updated 7 years ago
• wuchangfeng / vino-crawlers
  Some crawlers for getting data from the net.
  ☆209Updated 8 years ago
• SmileXie / zhihu_crawler
  Crawler of zhihu.com
  ☆268Updated 7 years ago
• lzjun567 / note
  学习笔记
  ☆635Updated 5 years ago
• gnemoug / sina_reptile
  获取新浪微博1000w用户的基本信息和每个爬取用户最近发表的50条微博,使用python编写，多进程爬取，将数据存储在了mongodb中
  ☆473Updated 12 years ago
• tanteng / learn-python
  学习python3小脚本
  ☆357Updated 8 years ago
• wangshunping / weibo_spider
  graduate project, a weibo spider to find some interesting information such as "In social network , people tend to be happy or sad."
  ☆273Updated 8 years ago
• LiuRoy / huatian-funny
  科学地分析自己的择偶观
  ☆239Updated 8 years ago
• eastrd / HighAnonProxyPool
  A proxy pool that scrapes free anonymous proxies and maintains its proxies' availability.
  ☆93Updated 7 years ago
• StephinChou / Pythonspider
  一个简单的python爬虫，原生python+BeautifulSoup
  ☆157Updated 6 years ago
• atonasting / zhihuspider
  网站「看知乎」的爬虫
  ☆880Updated 7 years ago
• MorganZhang100 / zhihu-spider
  A web spider for zhihu.com
  ☆725Updated last year
• ladingwu / python_zhihu
  一个知乎爬虫，登陆，获取答案，图片
  ☆308Updated 4 years ago
• zrools / spider
  ☆114Updated 8 years ago
• gavin66 / proxy_list
  爬取免费可用代理，供爬虫等工具使用
  ☆589Updated 5 years ago
• AnyISalIn / zhihu_fun
  基于 Selenium 的知乎关键词爬虫
  ☆185Updated 7 years ago
• yjm12321 / zhihu-girl
  抓取知乎妹子头像
  ☆111Updated 8 years ago
• zhangchenchen / proxyspider
  代理IP 采集程序
  ☆263Updated 7 years ago
• KaimingWan / PureBlog
  It is a blog website which is developed with python
  ☆165Updated 8 years ago
• princehaku / pyrailgun
  Simple And Easy Python Crawler Framework，支持抓取javascript渲染的页面的简单实用高效的python网页爬虫抓取模块
  ☆377Updated 3 years ago
• Andrew-liu / my_blog_tutorial
  It's the example of the development of blog by Django and Pure.
  ☆379Updated 7 years ago