yida-lxw / spider4jLinks
Spider4j is an open source web crawler expand from webmagic for Java which provides a simple interface for crawling the Web. Using it, you can setup a multi-threaded web crawler in few minutes.
☆18Updated 2 years ago
Alternatives and similar repositories for spider4j
Users that are interested in spider4j are comparing it to the libraries listed below
Sorting:
- 简单实用的同步工具,实现mysql数据库中数据定期同步到elasticsearch,只需简单的配置,便能达到非凡的效果,支持elasticsearch 5.X版本☆48Updated 9 years ago
- kafa spring插件☆14Updated 10 years ago
- Gecko crawler supports distributed by redis☆24Updated 7 years ago
- 基于Drools的规则引擎系统☆98Updated 12 years ago
- Gecco crawler downloader for htmlunit☆27Updated 9 years ago
- 基于Solr4.9.0的搜索系统:包括Solr索引建立、Solr索引查询DUBBO接口等内容。☆30Updated 3 years ago
- 日志分析器,仿造elk中logstash的简单Java实现,实现监控目录日志,自动解析存入elasticsearch。☆22Updated 9 years ago
- DEPRECATED☆27Updated 7 years ago
- 一个基于Spring Boot的Storm开发手脚架,开箱即用!集成读写Kafka、写Redis、写MySQL示例。☆59Updated 7 years ago
- shiro 基于 url做的权限系统☆43Updated 10 years ago
- spring-boot集成实例 mybatis,mail,mysql,mongodb,cassandra,scheduler,redis,kafka,shiro,websocket 1.集成单数据源mybatis 2.集成多数据源mybatis 3.集成邮件mail 4.集…☆26Updated 8 years ago
- Dubbox整合Spring Boot基于Avro、Thrift协议构建REST服务☆40Updated 9 years ago
- 基于ActiveMQ的数据交换中间件☆14Updated 11 years ago
- 基于zookeeper的统一配置中心实现☆46Updated 10 years ago
- xxl-job-admin 任务调度平台 Spring Boot 版本[后台部分] ,统一改为rest接口☆39Updated 3 years ago
- YMP开发框架是一套轻量级的JAVA应用开发框架,具有统一的配置体系结构、系统与业务日志分离、插件化开发模式、简单轻量的MVC和持久化支持等特性;☆33Updated 7 years ago
- Groovy based lightweight rule engine☆82Updated 9 years ago
- 大规模分布式系统的跟踪、监控、告警平台☆55Updated 11 years ago
- 乐视集团支付订单系统分库分表开源实现☆124Updated 8 years ago
- 基于Drools的规则引擎☆137Updated 9 years ago
- spring cloud云权限架构☆45Updated 7 years ago
- dubbox的介绍和简单示例☆78Updated 9 years ago
- unified exception framework(统一异常处理框架:统一的异常日志记录、异常通知,etc)☆18Updated 9 years ago
- 这是一个ZooKeeper客户端,实现了断线重连,会话过期重连,永久监听,子节点数据变化的监听。并且加入了常用功能,例如分布式锁,Leader选举,主从服务锁,分布式队列等。☆26Updated 9 years ago
- 根据实际项目的需求,实现一个适合由单应用扩展到多应用的架构。在项目的最初设定就是一个适合多模块扩展的架构,最初是单应用架构,以包区分模块。当项目需求增大的时候,会先实现多机部署,接下来进行项目拆分,进行集群部署。每个阶段都会整合一个架构,提供对应的解决方案。☆129Updated 8 years ago
- 舆情搜索服务框架,其中lucene和solr版本为4.8。☆61Updated 9 years ago
- 一个简化kettle插件开发的通用插件,采用JSON作为参数配置,省去ui调试设计步骤,只需一个类就可以开发一个插件。☆40Updated 3 years ago
- 电商平台☆51Updated 9 years ago
- tcc-transaction是TCC型事务java实现☆14Updated 8 years ago
- activiti-engine-5.12 with bboss☆46Updated last month