Alternatives and similar repositories for doubanMovieCrawler

Users that are interested in doubanMovieCrawler are comparing it to the libraries listed below

• yuki-lau / weibo-spider
  新浪微博爬虫，采用Java语言开发，基于HTTPClient 4.0，采用MySQL存储爬取数据，支持多进程并发执行。功能包括：爬取微博、评论、转发、关注列表（层次）。根据数据需求，持续更新...
  ☆354Updated 11 years ago
• matuobasyouca / spider
  a simple distributed spider in Java. Java编写的一个简单分布式爬虫
  ☆159Updated 12 years ago
• QiuMing / zhihuWebSpider
  知乎爬虫，基于webmagic框架 .A java web spider base on webmagic.
  ☆69Updated 9 years ago
• KKys / ZhiHuSpider
  Java无框架实现爬取知乎用户信息、图片和知乎推荐内容并下载到本地或数据库中
  ☆387Updated 8 years ago
• yoghurtjia / Zhihu_bigdata
  使用scrapy和pandas完成对知乎300w用户的数据分析。首先使用scrapy爬取知乎网的300w，用户资料，最后使用pandas对数据进行过滤，找出想要的知乎大牛，并用图表的形式可视化。
  ☆158Updated 7 years ago
• lucasxlu / LagouJob
  Data Analysis & Mining for lagou.com
  ☆263Updated 6 years ago
• ansenhuang / scrapy-zhihu-users
  scrapy爬取知乎用户数据
  ☆154Updated 9 years ago
• LiuRoy / huatian-funny
  科学地分析自己的择偶观
  ☆241Updated 9 years ago
• chensoul / scrapy-zhihu-github
  scrapy examples for crawling zhihu and github
  ☆224Updated 2 years ago
• Andrew-liu / scrapy_example
  This repository store some example to learn scrapy better
  ☆176Updated 4 years ago
• jxqlovejava / PopularBlogSites
  个人收集的觉得不错的技术站点或技术博客
  ☆221Updated 7 years ago
• CrawlScript / nutcher
  nutcher是中文的nutch文档，包含nutch的配置和源码解析，持续更新中。
  ☆130Updated 5 years ago
• gnemoug / sina_reptile
  获取新浪微博1000w用户的基本信息和每个爬取用户最近发表的50条微博,使用python编写，多进程爬取，将数据存储在了mongodb中
  ☆473Updated 12 years ago
• ScarecrowFu / crawllagou
  拉勾网爬虫 lagou spider
  ☆79Updated 3 years ago
• yoyzhou / weibo_scrapy
  WEIBO_SCRAPY is a Multi-Threading SINA WEIBO data extraction Framework in Python.
  ☆154Updated 7 years ago
• ClericPy / Spider_on_Tianmao_and_Taobao
  已废弃。 Spiders on Tianmao Taobao JingDong。停止更新
  ☆58Updated 8 years ago
• ClericPy / EC-Spider
  Obsolete 已废弃.
  ☆86Updated 8 years ago
• LiuXingMing / Tmall1212
  天猫双12爬虫，附商品数据。
  ☆200Updated 8 years ago
• letcheng / ProxyPool
  针对反爬虫问题的自动代理池组件
  ☆78Updated 8 years ago
• jackgitgz / CnblogsSpider
  用scrapy采集cnblogs列表页爬虫
  ☆275Updated 10 years ago
• wangshunping / weibo_spider
  graduate project, a weibo spider to find some interesting information such as "In social network , people tend to be happy or sad."
  ☆273Updated 9 years ago
• ZhangBohan / fun_crawler
  Crawl some picture for fun
  ☆162Updated 8 years ago
• omengye / spider
  python Movie Info Web Crawler
  ☆90Updated 8 years ago
• HunterChao / Crawler
  拉钩 | 豆瓣 | 链家爬虫项目的合集
  ☆316Updated 8 years ago
• qwIvan / 5184CAPTCHA
  识别5184验证码
  ☆79Updated 9 years ago
• MatrixSeven / ZhihuSpider
  知乎爬虫/可以爬出关注关系的爬虫
  ☆304Updated last month
• tpeng / weibosearch
  A distributed Sina Weibo Search spider base on Scrapy and Redis.
  ☆145Updated 12 years ago
• immzz / zhihu-scrapy
  A scrapy zhihu crawler
  ☆76Updated 6 years ago
• HunterChao / Dangdang
  scrapy爬取当当网图书数据
  ☆73Updated 8 years ago
• YaboSu / zhihu_crawler
  使用python 3实现的一个知乎内容的爬虫，依赖requests、BeautifulSoup4。
  ☆38Updated 9 years ago