Alternatives and similar repositories for crawlers

Users that are interested in crawlers are comparing it to the libraries listed below

• protream / iquery
  Various information query via command line.
  ☆703Updated 7 years ago
• dongweiming / commentbox
  网易云音乐精彩评论[关闭]
  ☆253Updated 8 years ago
• manning23 / MSpider
  Spider
  ☆347Updated 2 years ago
• SmileXie / zhihu_crawler
  Crawler of zhihu.com
  ☆269Updated 8 years ago
• littlecodersh / MyPlatform
  文科生也会配的微信个人号后台，Content based wechat massive platform framework, what you need to do is only adding your articles in :)
  ☆138Updated 8 years ago
• wuchangfeng / vino-crawlers
  Some crawlers for getting data from the net.
  ☆209Updated 8 years ago
• leitro / knowsecSpider2
  知道创宇爬虫题目 持续更新版本
  ☆94Updated 10 years ago
• phith0n / Minos
  一个基于Tornado/mongodb/redis的社区系统。
  ☆674Updated 5 years ago
• taizilongxu / douban.fm
  douban.fm based on Python
  ☆785Updated 6 years ago
• x2c3z4 / wechat-sendall
  给好友群发有诚意的消息喔
  ☆227Updated 9 years ago
• awolfly9 / jd_analysis
  京东商城评价信息数据分析。查看示例：http://awolfly9.com/article/jd_comment_analysis
  ☆254Updated 8 years ago
• spacelan / wechat-emoticon
  微信表情轰炸器
  ☆237Updated 8 years ago
• zrools / spider
  ☆113Updated 9 years ago
• zhangchenchen / proxyspider
  代理IP 采集程序
  ☆263Updated 7 years ago
• LiuRoy / huatian-funny
  科学地分析自己的择偶观
  ☆241Updated 9 years ago
• flyhigher139 / awesome-github-repo
  A curated list of awesome GitHub repositories. Inspired by awesome-python, which is inspired by awesome-php.
  ☆642Updated 2 years ago
• dongweiming / Mtime
  A spider... ^.^
  ☆99Updated 11 years ago
• moxiegushi / zhihu
  知乎爬虫（验证码自动识别）
  ☆534Updated 6 years ago
• eastrd / HighAnonProxyPool
  A proxy pool that scrapes free anonymous proxies and maintains its proxies' availability.
  ☆93Updated 7 years ago
• StephinChou / Pythonspider
  一个简单的python爬虫，原生python+BeautifulSoup
  ☆157Updated 6 years ago
• nladuo / taobao_bra_crawler
  a taobao web crawler just for fun.
  ☆196Updated 6 years ago
• FullerHua / gooseeker
  ☆697Updated 8 years ago
• liduanwei / ItChat
  API for Wechat. 微信个人号接口（支持文件、图片上下载）、微信机器人及命令行微信。三十行即可自定义个人号机器人。
  ☆273Updated 9 years ago
• lucasxlu / LagouJob
  Data Analysis & Mining for lagou.com
  ☆263Updated 6 years ago
• ZhangBohan / fun_crawler
  Crawl some picture for fun
  ☆162Updated 8 years ago
• gnemoug / sina_reptile
  获取新浪微博1000w用户的基本信息和每个爬取用户最近发表的50条微博,使用python编写，多进程爬取，将数据存储在了mongodb中
  ☆472Updated 12 years ago
• AnyISalIn / zhihu_fun
  基于 Selenium 的知乎关键词爬虫
  ☆185Updated 7 years ago
• lzjun567 / note
  学习笔记
  ☆635Updated 6 years ago
• Skycrab / weixin-knife
  weixin python framework
  ☆323Updated 5 years ago
• ansenhuang / scrapy-zhihu-users
  scrapy爬取知乎用户数据
  ☆153Updated 9 years ago