Alternatives and similar repositories for webcrawler

Users that are interested in webcrawler are comparing it to the libraries listed below

• jin10086 / pachong
  一些爬虫的代码
  ☆147Updated 6 years ago
• kulovecc / jandan_spider
  使用Python3爬取煎蛋图片
  ☆178Updated 5 years ago
• AlexTan-b-z / ZhihuSpider
  知乎分布式爬虫（Scrapy、Redis）
  ☆169Updated 7 years ago
• l-passer / Passer-zhihu
  用Python看知乎
  ☆175Updated 7 years ago
• gzm1997 / wxImage
  ☆92Updated 7 years ago
• moranzcw / Zhihu-Spider
  一个获取知乎用户主页信息的多线程Python爬虫程序。
  ☆139Updated 6 years ago
• luyishisi / Nyspider
  各种爬虫---大众点评,安居客，58，人人贷，拍拍贷, IT桔子,拉勾网，豆瓣,搜房网,ASO100,气象数据,猫眼电影,链家,PM25.in...
  ☆196Updated 8 years ago
• changetjut / ProxySpider
  爬取http://www.xicidaili.com/上代理IP，并验证代理可用性
  ☆144Updated 5 years ago
• Germey / Zhihu
  Zhihu User Spider
  ☆133Updated 6 years ago
• lucasxlu / LagouJob
  Data Analysis & Mining for lagou.com
  ☆263Updated 6 years ago
• qiyeboy / spider_smooc
  爬取慕课网视频
  ☆365Updated 7 years ago
• ladingwu / python_zhihu
  一个知乎爬虫，登陆，获取答案，图片
  ☆309Updated 4 years ago
• darrenfantasy / image_crawler
  网站图片爬虫(已包含：微博，微信公众号，花瓣网)及免费IP代理 豆瓣电影爬虫
  ☆144Updated 7 years ago
• Qutan / Spider
  社交数据爬虫
  ☆217Updated 8 years ago
• JustForFunnnn / webspider
  A website of IT position data & analysis, helps you to get a better understanding of the requirements and trends of the IT job market
  ☆371Updated last year
• xiaosimao / AiSpider
  爬虫轻型框架
  ☆231Updated 6 years ago
• LiuXingMing / Tmall1212
  天猫双12爬虫，附商品数据。
  ☆199Updated 8 years ago
• Rockyzsu / getProxy
  爬虫获取http://www.xicidaili.com/ 代理服务器
  ☆84Updated 7 years ago
• forezp / ZhihuSpiderMan
  Python爬虫系列
  ☆163Updated 6 years ago
• Rockyzsu / zhihuToKindle
  模拟登陆知乎，获取关注问题的id下 所有答案，并推送到kindle电子书
  ☆146Updated 5 years ago
• zmb4973992 / 2
  利用requests和lxml爬取妹子图片网
  ☆45Updated 2 years ago
• HunterChao / Crawler
  拉钩 | 豆瓣 | 链家爬虫项目的合集
  ☆317Updated 8 years ago
• StephinChou / Pythonspider
  一个简单的python爬虫，原生python+BeautifulSoup
  ☆157Updated 6 years ago
• AnyISalIn / zhihu_fun
  基于 Selenium 的知乎关键词爬虫
  ☆185Updated 7 years ago
• ZKeeer / IPProxy
  爬虫所需要的IP代理，抓取九个网站的代理IP检测/清洗/入库/更新，添加调用接口
  ☆141Updated 7 years ago
• zgbgx / P2PDA
  use the data scrapied from a third-party website to analyse chinese P2P industry(使用从第三方数据网站爬取的数据分析中国P2P)
  ☆84Updated 7 years ago
• simapple / spider
  test
  ☆163Updated 2 years ago
• youfou / hsdata
  用数据玩炉石！快速收集和分析炉石传说的卡牌及卡组数据
  ☆113Updated 8 years ago
• Germey / TouTiao
  TouTiao Spider Demo
  ☆177Updated 6 years ago
• dragonflylxp / crawler
  python爬虫项目集合
  ☆28Updated 5 years ago