matuobasyouca / spider
a simple distributed spider in Java. Java编写的一个简单分布式爬虫
☆159Updated 11 years ago
Alternatives and similar repositories for spider:
Users that are interested in spider are comparing it to the libraries listed below
- 知乎爬虫，基于webmagic框架 .A java web spider base on webmagic.☆69Updated 8 years ago
- A Demo For Dubbo☆34Updated 10 years ago
- 针对反爬虫问题的自动代理池组件☆78Updated 8 years ago
- SpringMVC+Mybatis 脚手架☆91Updated 7 years ago
- 设计模式_Java实现☆33Updated last year
- A lite distributed Java spider framework :-)☆145Updated 7 years ago
- 使用java+httpclient+httpcleaner，多线程、分布式爬去电商网站商品信息，数据存储在hbase上，并使用solr对商品建立索引，使用redis队列存储一个共享的url仓库；使用zookeeper对爬虫节点生命周期进行监视等。☆231Updated 4 years ago
- 一个基于SAE Java平台的微信平台公众帐号应用例子（使用Spring/SpringMVC/MyBatis框架）详情访问：http://aixuexiao.sinaapp.com☆232Updated 11 years ago
- 基于netty通信框架的轻量级、高性能RESTful服务，用于构建分布式系统。☆127Updated 12 years ago
- lucene实现web项目近实时搜索【solr和NRTManager、SearcherManager】☆65Updated 9 years ago
- ☆86Updated 9 years ago
- java 高并发处理☆50Updated 7 years ago
- 豆瓣电影爬虫——a crawler which is able to crawl movie detail and short comments, save them to database mysql, also include Sentiment analysis ba…☆69Updated 5 years ago
- 新浪微博爬虫，采用Java语言开发，基于HTTPClient 4.0，采用MySQL存储爬取数据，支持多进程并发执行。功能包括：爬取微博、评论、转发、关注列表（层次）。根据数据需求，持续更新...☆352Updated 11 years ago
- java 并发学习笔记☆98Updated 9 years ago
- 基于hadoop思维的分布式网络爬虫。☆86Updated 9 years ago
- A simple and support the restful structure of the Java MVC framework, I have little talent and less learning, we hope the exhibitions☆63Updated 8 years ago
- spring+springmvc+mybatis+maven+freemarker 能跑通的小例子，尽量通俗易懂☆80Updated 8 years ago
- 使用WebMagic抓取招聘信息，并且持久化到Mysql的例子。☆224Updated 8 years ago
- doubanMovieCrawler,for collecting lastest movie☆49Updated 7 years ago
- 《Java并发编程实战 - Java Concurrency in Practice》，实践书中的例子，看哪些可以用于实际项目中。（但在使用之前，需要经过详细的单元和性能测试。）☆38Updated 8 years ago
- 基于dubbo的一个分布式项目demo☆105Updated 7 years ago
- 网络爬虫☆51Updated 11 years ago
- database read and write separation of java☆118Updated 7 years ago
- 基于Java，Spring，Maven实现的微信公众平台一整套代码，从前端Controller到后端的Dao的实现☆228Updated 10 years ago
- JavaWeb秒杀项目学习实例☆41Updated 5 years ago
- 基础框架，通用功能封装☆148Updated 7 years ago
- 微信、微博、QQ登录、腾讯微博...☆244Updated 8 years ago
- spring + hibernate + Struts2集成，spring + Struts2 + mybatis集成演示☆80Updated 9 years ago
- 基于 JDK8 实现的轻量级 Java Web 框架☆262Updated 8 years ago