Alternatives and similar repositories for doubanMovieCrawler

Users that are interested in doubanMovieCrawler are comparing it to the libraries listed below

• matuobasyouca / spider
  a simple distributed spider in Java. Java编写的一个简单分布式爬虫
  ☆159Updated 12 years ago
• yuki-lau / weibo-spider
  新浪微博爬虫，采用Java语言开发，基于HTTPClient 4.0，采用MySQL存储爬取数据，支持多进程并发执行。功能包括：爬取微博、评论、转发、关注列表（层次）。根据数据需求，持续更新...
  ☆355Updated 11 years ago
• QiuMing / zhihuWebSpider
  知乎爬虫，基于webmagic框架 .A java web spider base on webmagic.
  ☆69Updated 9 years ago
• CrawlScript / nutcher
  nutcher是中文的nutch文档，包含nutch的配置和源码解析，持续更新中。
  ☆130Updated 6 years ago
• ansenhuang / scrapy-zhihu-users
  scrapy爬取知乎用户数据
  ☆154Updated 9 years ago
• LiuRoy / huatian-funny
  科学地分析自己的择偶观
  ☆241Updated 9 years ago
• chensoul / scrapy-zhihu-github
  scrapy examples for crawling zhihu and github
  ☆223Updated 2 years ago
• yoghurtjia / Zhihu_bigdata
  使用scrapy和pandas完成对知乎300w用户的数据分析。首先使用scrapy爬取知乎网的300w，用户资料，最后使用pandas对数据进行过滤，找出想要的知乎大牛，并用图表的形式可视化。
  ☆159Updated 8 years ago
• lucasxlu / LagouJob
  Data Analysis & Mining for lagou.com
  ☆263Updated 6 years ago
• jxqlovejava / PopularBlogSites
  个人收集的觉得不错的技术站点或技术博客
  ☆220Updated 7 years ago
• ScarecrowFu / crawllagou
  拉勾网爬虫 lagou spider
  ☆78Updated 3 years ago
• KKys / ZhiHuSpider
  Java无框架实现爬取知乎用户信息、图片和知乎推荐内容并下载到本地或数据库中
  ☆388Updated 8 years ago
• gnemoug / sina_reptile
  获取新浪微博1000w用户的基本信息和每个爬取用户最近发表的50条微博,使用python编写，多进程爬取，将数据存储在了mongodb中
  ☆474Updated 12 years ago
• hfut-dmic / ContentExtractor
  自动抽取网页正文的算法，用JAVA实现
  ☆109Updated 8 years ago
• HunterChao / Dangdang
  scrapy爬取当当网图书数据
  ☆72Updated 8 years ago
• immzz / zhihu-scrapy
  A scrapy zhihu crawler
  ☆77Updated 7 years ago
• yoyzhou / weibo_scrapy
  WEIBO_SCRAPY is a Multi-Threading SINA WEIBO data extraction Framework in Python.
  ☆155Updated 8 years ago
• Andrew-liu / scrapy_example
  This repository store some example to learn scrapy better
  ☆177Updated 5 years ago
• letcheng / ProxyPool
  针对反爬虫问题的自动代理池组件
  ☆79Updated 8 years ago
• zongtui / zongtui-webcrawler
  基于hadoop思维的分布式网络爬虫。
  ☆86Updated 9 years ago
• callmewhy / ZhihuDown
  知乎下巴，爬取知乎网页内容
  ☆48Updated 11 years ago
• qwIvan / 5184CAPTCHA
  识别5184验证码
  ☆79Updated 9 years ago
• luohaha / jlitespider
  A lite distributed Java spider framework :-)
  ☆145Updated 8 years ago
• ClericPy / Spider_on_Tianmao_and_Taobao
  已废弃。 Spiders on Tianmao Taobao JingDong。停止更新
  ☆58Updated 8 years ago
• LiuXingMing / Tmall1212
  天猫双12爬虫，附商品数据。
  ☆201Updated 8 years ago
• ericzhang-cn / rss2epub
  将RSS内容转为epub格式电子书的工具
  ☆65Updated 2 years ago
• Tachone / zhihu_spider
  large-scale user information crawler of zhihu
  ☆77Updated 8 years ago
• shelmesky / crawler
  淘宝爬虫原型，基于gevent
  ☆49Updated 12 years ago
• ClericPy / EC-Spider
  Obsolete 已废弃.
  ☆86Updated 8 years ago
• maxliaops / scrapy-itzhaopin
  ☆95Updated 11 years ago