源码主要用于学习:1. Spring Boot+Hadoop+Hive+Hbase实现数据基本操作,Hive数据源使用Alibaba DruidDataSource,以及JDBCTemplate操作数据, Hbase使用hbase-client实现数据操作, API可视化界面集成Swagger-UI 2.9.2。2.引入Azkaban离线任务调度,实现Hive数据分层ETL过程,并结合Sqoop实现数据从Hive同步到MySQL操作。3. 引入Kafka消息服务,实现前端日志收集,将消息接收到的数据包持久化到Hive ODS原始数据层。4. 通过SpringBoot API方式提供可视化数据访问服务。
☆21Jul 27, 2021Updated 5 years ago
Alternatives and similar repositories for com-hadoop-bigdata-demo
Users that are interested in com-hadoop-bigdata-demo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 此工程采用SpringBoot + Mybatis + Hive框架进行集成。☆23Mar 15, 2018Updated 8 years ago
- Apache Hive / Hadoop Spring Boot Microservice☆18Nov 24, 2018Updated 7 years ago
- springboot kafka application in a Kubernetes cluster that is relased through helm☆10Feb 6, 2024Updated 2 years ago