bys-eric-he / com-hadoop-bigdata-demoView external linksLinks
源码主要用于学习:1. Spring Boot+Hadoop+Hive+Hbase实现数据基本操作,Hive数据源使用Alibaba DruidDataSource,以及JDBCTemplate操作数据, Hbase使用hbase-client实现数据操作, API可视化界面集成Swagger-UI 2.9.2。2.引入Azkaban离线任务调度,实现Hive数据分层ETL过程,并结合Sqoop实现数据从Hive同步到MySQL操作。3. 引入Kafka消息服务,实现前端日志收集,将消息接收到的数据包持久化到Hive ODS原始数据层。4. 通过SpringBoot API方式提供可视化数据访问服务。
☆22Jul 27, 2021Updated 4 years ago
Alternatives and similar repositories for com-hadoop-bigdata-demo
Users that are interested in com-hadoop-bigdata-demo are comparing it to the libraries listed below
Sorting:
- k8s hadoop,在k8s上快速搭建一个hadoop/hbase/hive环境,很早的项目自已用,腾讯tbds培训,以此为基础(多了一个kafka/flink)搭一套环境练习,又捡起来了☆22Mar 21, 2021Updated 4 years ago
- 此工程采用SpringBoot + Mybatis + Hive框架进行集成。☆23Mar 15, 2018Updated 7 years ago
- Docker-compose contains the most common big data systems like: Apache Hadoop, Apache Hive, Apache Spark, Jupyter, Flink☆29Oct 9, 2023Updated 2 years ago
- ☆11May 7, 2025Updated 9 months ago
- 支持分库分表jdbc的flink connector☆10Dec 31, 2021Updated 4 years ago
- Kubenetes with SpringBoot demo☆10Feb 20, 2019Updated 6 years ago
- ☆11Jan 23, 2019Updated 7 years ago
- hadoop中Map/Reduce使用示例,输入(DBInputFormat),输出(DBOutputFormat)为MySql数据库表、日志分析Grep、单词排序Sort...对HBase的基本操作,增、删、查、改,使用Map/Reduce批量导入数据到HBase表中..…☆14Apr 6, 2013Updated 12 years ago
- 本项目主要用于搭建一个基于docker的实时监控系统,涉及的大数据相关组件有Filebeat,Kafka,Zookeeper,Flink,后端主要使用了SpringBoot进行开发,数据库使用了Redis做缓存,前端用了Vue框架,通过Ant Design组件库和Echar…☆42Jan 5, 2023Updated 3 years ago
- 将P站下载的动图压缩包转换为Gif图。☆10Nov 25, 2017Updated 8 years ago
- Spring-boot Oauth2 example with jwt and Redis☆12Feb 5, 2025Updated last year
- Hadoop, Hive, Spark, Zeppelin and Livy: all in one Docker-compose file.☆11Apr 30, 2022Updated 3 years ago
- 业务规则管理系统,集成Drools,以数据库的形式实现决策表,提供动态规则配置功能☆10Nov 15, 2022Updated 3 years ago
- POC for all the stack of big data (kafka, spark, cassandra, hdfs, docker, springboot)☆12Dec 16, 2022Updated 3 years ago
- 对etcd中实现的raft算法进行注释☆11Jun 6, 2017Updated 8 years ago
- 王道考研 操作系统 教学视频:https://www.bilibili.com/video/BV1YE411D7nH☆11Mar 20, 2021Updated 4 years ago
- EVM-compatible Cosmos Chain for scalable and interoperable DApps and smart contracts, integrating Ethereum's robust features with Cosmos'…☆12Dec 22, 2023Updated 2 years ago
- A simple project demonstrates the integration of Spring boot, ActiveMQ, Camel and STOMP☆11Aug 31, 2016Updated 9 years ago
- Scripts for installing Hadoop, HBase, Hive, Pig & Spark.☆10Nov 13, 2019Updated 6 years ago
- 汇集各类字体,包括手写体,韩文等☆11Jan 24, 2024Updated 2 years ago
- ☆11Sep 5, 2023Updated 2 years ago
- 🚀 Material-UI based Audio Player☆10Dec 2, 2022Updated 3 years ago
- A Basic Flink Application Consuming & Aggregating Kafka Messages☆10Nov 8, 2019Updated 6 years ago
- ☆14Nov 16, 2022Updated 3 years ago
- Backend for KtDevBox frame based on Django☆20Jun 22, 2021Updated 4 years ago
- Netflix-Inspired Streaming App Clone (React + TypeScript + Styled Components) Experience a sleek, Netflix-style streaming platform built…☆12Jul 6, 2025Updated 7 months ago
- emqxv5-with-kafka-brod☆14Oct 17, 2025Updated 3 months ago
- ☆11Dec 5, 2018Updated 7 years ago
- 非侵入代码的java自动分批提交数据组件☆10Nov 25, 2017Updated 8 years ago
- 纯手写mybatis(注解版)☆13Jan 17, 2019Updated 7 years ago
- A dockerized small bigdata cluster to play with☆13Jun 14, 2016Updated 9 years ago
- ☆14Nov 3, 2016Updated 9 years ago
- 1. OkHttpClient基本参数配置介绍 2. 普通GET请求(同步/异步) 3. 普通POST请求(同步/异步) 4. 根据tag取消请求 5. POST请求提交String 6. POST请求提交流 7. POST请求提交JSON(实体转JSON) 8. POST…☆12Jul 26, 2018Updated 7 years ago
- Springboot + ElasticSearch 构建博客检索系统☆12Mar 5, 2020Updated 5 years ago
- A consumer of a Kafka topic based on Flink☆12Oct 5, 2022Updated 3 years ago
- flink sql☆11Jun 21, 2022Updated 3 years ago
- How to setup a minimal Hadoop cluster using Docker☆11Mar 13, 2022Updated 3 years ago
- 大数据学习:各种计算框架:☆11May 20, 2022Updated 3 years ago
- Lecture: Big Data☆14Oct 27, 2025Updated 3 months ago