Alternatives and similar repositories for crawlers

Users that are interested in crawlers are comparing it to the libraries listed below

• manning23 / MSpider
  Spider
  ☆347Updated 3 years ago
• dongweiming / commentbox
  网易云音乐精彩评论[关闭]
  ☆253Updated 8 years ago
• protream / iquery
  Various information query via command line.
  ☆703Updated 8 years ago
• SmileXie / zhihu_crawler
  Crawler of zhihu.com
  ☆270Updated 8 years ago
• StephinChou / Pythonspider
  一个简单的python爬虫，原生python+BeautifulSoup
  ☆157Updated 6 years ago
• phith0n / Minos
  一个基于Tornado/mongodb/redis的社区系统。
  ☆674Updated 6 years ago
• x2c3z4 / wechat-sendall
  给好友群发有诚意的消息喔
  ☆229Updated 9 years ago
• FullerHua / gooseeker
  ☆695Updated 9 years ago
• awolfly9 / jd_analysis
  京东商城评价信息数据分析。查看示例：http://awolfly9.com/article/jd_comment_analysis
  ☆253Updated 8 years ago
• tanteng / learn-python
  学习python3小脚本
  ☆360Updated 9 years ago
• LiuRoy / huatian-funny
  科学地分析自己的择偶观
  ☆241Updated 9 years ago
• leitro / knowsecSpider2
  知道创宇爬虫题目 持续更新版本
  ☆94Updated 11 years ago
• littlecodersh / MyPlatform
  文科生也会配的微信个人号后台，Content based wechat massive platform framework, what you need to do is only adding your articles in :)
  ☆138Updated 9 years ago
• yjm12321 / zhihu-girl
  抓取知乎妹子头像
  ☆110Updated 9 years ago
• omengye / spider
  python Movie Info Web Crawler
  ☆94Updated 8 years ago
• zrools / spider
  ☆113Updated 9 years ago
• princehaku / pyrailgun
  Simple And Easy Python Crawler Framework，支持抓取javascript渲染的页面的简单实用高效的python网页爬虫抓取模块
  ☆379Updated 4 years ago
• liduanwei / ItChat
  API for Wechat. 微信个人号接口（支持文件、图片上下载）、微信机器人及命令行微信。三十行即可自定义个人号机器人。
  ☆274Updated 9 years ago
• jiehua233 / ipproxy
  代理IP提取工具
  ☆116Updated 8 years ago
• wuchangfeng / vino-crawlers
  Some crawlers for getting data from the net.
  ☆207Updated 9 years ago
• bigstupidx / Pythonspider
  一个简单的python爬虫，原生python+BeautifulSoup
  ☆45Updated 9 years ago
• ZhangBohan / fun_crawler
  Crawl some picture for fun
  ☆162Updated 8 years ago
• nladuo / taobao_bra_crawler
  a taobao web crawler just for fun.
  ☆198Updated 7 years ago
• eastrd / HighAnonProxyPool
  A proxy pool that scrapes free anonymous proxies and maintains its proxies' availability.
  ☆94Updated 8 years ago
• PyCN / PTR
  PyCN技术评论（PyCN Technology Review）——Py字幕组出品
  ☆131Updated 8 years ago
• wangshunping / weibo_spider
  graduate project, a weibo spider to find some interesting information such as "In social network , people tend to be happy or sad."
  ☆272Updated 9 years ago
• ansenhuang / scrapy-zhihu-users
  scrapy爬取知乎用户数据
  ☆154Updated 9 years ago
• gnemoug / sina_reptile
  获取新浪微博1000w用户的基本信息和每个爬取用户最近发表的50条微博,使用python编写，多进程爬取，将数据存储在了mongodb中
  ☆474Updated 12 years ago
• LinSuper / zhihu_spider
  抓取给定知乎问题链接下所有图片,代码包括后台
  ☆133Updated 9 years ago
• AnyISalIn / zhihu_fun
  基于 Selenium 的知乎关键词爬虫
  ☆185Updated 8 years ago