Alternatives and similar repositories for crawlers

Users that are interested in crawlers are comparing it to the libraries listed below

• protream / iquery
  Various information query via command line.
  ☆703Updated 8 years ago
• dongweiming / commentbox
  网易云音乐精彩评论[关闭]
  ☆253Updated 8 years ago
• manning23 / MSpider
  Spider
  ☆347Updated 3 years ago
• SmileXie / zhihu_crawler
  Crawler of zhihu.com
  ☆270Updated 8 years ago
• liduanwei / ItChat
  API for Wechat. 微信个人号接口（支持文件、图片上下载）、微信机器人及命令行微信。三十行即可自定义个人号机器人。
  ☆273Updated 9 years ago
• AnyISalIn / zhihu_fun
  基于 Selenium 的知乎关键词爬虫
  ☆185Updated 8 years ago
• awolfly9 / jd_analysis
  京东商城评价信息数据分析。查看示例：http://awolfly9.com/article/jd_comment_analysis
  ☆253Updated 8 years ago
• FullerHua / gooseeker
  ☆697Updated 8 years ago
• StephinChou / Pythonspider
  一个简单的python爬虫，原生python+BeautifulSoup
  ☆157Updated 6 years ago
• LiuRoy / huatian-funny
  科学地分析自己的择偶观
  ☆241Updated 9 years ago
• iamyaojie / Spider
  Wandering Spider
  ☆236Updated 8 years ago
• x2c3z4 / wechat-sendall
  给好友群发有诚意的消息喔
  ☆228Updated 9 years ago
• littlecodersh / MyPlatform
  文科生也会配的微信个人号后台，Content based wechat massive platform framework, what you need to do is only adding your articles in :)
  ☆138Updated 9 years ago
• phith0n / Minos
  一个基于Tornado/mongodb/redis的社区系统。
  ☆674Updated 6 years ago
• princehaku / pyrailgun
  Simple And Easy Python Crawler Framework，支持抓取javascript渲染的页面的简单实用高效的python网页爬虫抓取模块
  ☆380Updated 3 years ago
• wuchangfeng / vino-crawlers
  Some crawlers for getting data from the net.
  ☆209Updated 8 years ago
• zrools / spider
  ☆113Updated 9 years ago
• jiehua233 / ipproxy
  代理IP提取工具
  ☆116Updated 7 years ago
• gnemoug / sina_reptile
  获取新浪微博1000w用户的基本信息和每个爬取用户最近发表的50条微博,使用python编写，多进程爬取，将数据存储在了mongodb中
  ☆473Updated 12 years ago
• flyhigher139 / awesome-github-repo
  A curated list of awesome GitHub repositories. Inspired by awesome-python, which is inspired by awesome-php.
  ☆641Updated 2 years ago
• eastrd / HighAnonProxyPool
  A proxy pool that scrapes free anonymous proxies and maintains its proxies' availability.
  ☆94Updated 7 years ago
• wangshunping / weibo_spider
  graduate project, a weibo spider to find some interesting information such as "In social network , people tend to be happy or sad."
  ☆272Updated 9 years ago
• tanteng / learn-python
  学习python3小脚本
  ☆359Updated 9 years ago
• leitro / knowsecSpider2
  知道创宇爬虫题目 持续更新版本
  ☆94Updated 10 years ago
• plough / myCrawler
  我的爬虫练习
  ☆278Updated 4 years ago
• smartFlash / pySecurity
  Python tutorials
  ☆668Updated 5 years ago
• da2vin / Sasila
  一个灵活、友好的爬虫框架
  ☆296Updated 3 years ago
• yjm12321 / zhihu-girl
  抓取知乎妹子头像
  ☆111Updated 9 years ago
• omengye / spider
  python Movie Info Web Crawler
  ☆90Updated 8 years ago
• Tachone / zhihu_spider
  large-scale user information crawler of zhihu
  ☆77Updated 8 years ago