源码主要用于学习：1. Spring Boot+Hadoop+Hive+Hbase实现数据基本操作,Hive数据源使用Alibaba DruidDataSource，以及JDBCTemplate操作数据, Hbase使用hbase-client实现数据操作, API可视化界面集成Swagger-UI 2.9.2。2.引入Azkaban离线任务调度，实现Hive数据分层ETL过程，并结合Sqoop实现数据从Hive同步到MySQL操作。3. 引入Kafka消息服务，实现前端日志收集，将消息接收到的数据包持久化到Hive ODS原始数据层。4. 通过SpringBoot API方式提供可视化数据访问服务。
☆22Jul 27, 2021Updated 4 years ago
Alternatives and similar repositories for com-hadoop-bigdata-demo
Users that are interested in com-hadoop-bigdata-demo are comparing it to the libraries listed below
Sorting:
- 此 工程采用SpringBoot + Mybatis + Hive框架进行集成。☆23Mar 15, 2018Updated 7 years ago
- Docker-compose contains the most common big data systems like: Apache Hadoop, Apache Hive, Apache Spark, Jupyter, Flink☆29Oct 9, 2023Updated 2 years ago
- 前段时间自己的网站涉及到支付功能（自己网站后台是node.js开发的），在阅读了官方文档之后，打算在git上找一下开源的支付接口，没想到一个都不能使用，最后无赖自己根据官网资料，自己写了这个接口，原理比较简单，其实没有那么复杂，希望对初学者有帮助，如果有错误还望指出（本接…☆12Aug 1, 2017Updated 8 years ago
- A sample project shows how to run Spark Streaming app with Kafka in Docker☆36Oct 25, 2017Updated 8 years ago
- ☆11May 7, 2025Updated 10 months ago
- 一键搭建zookeeper/hadoop/hive/hbase/sqoop/kafka/spark/kylin☆33Jan 2, 2020Updated 6 years ago
- ☆11Jan 23, 2019Updated 7 years ago
- Kubenetes with SpringBoot demo☆10Feb 20, 2019Updated 7 years ago
- 支持分库分表jdbc的flink connector☆10Dec 31, 2021Updated 4 years ago
- 大数据企业实训项目：基于SpringMVC+Spring+HBase+Maven搭建的Hadoop分布式云盘系统。使用Hadoop HDFS作为文件 存储系统、HBase作为数据存储仓库，采用SpringMVC+Spring框架实现，包括用户注册与登录、我的网盘、关注用户、我…☆12Dec 16, 2022Updated 3 years ago
- 小白大数据学习笔记☆47Nov 28, 2022Updated 3 years ago
- hadoop中Map/Reduce使用示例，输入(DBInputFormat),输出(DBOutputFormat)为MySql数据库表、日志分析Grep、单词排序Sort...对HBase的基本操作，增、删、查、改，使用Map/Reduce批量导入数据到HBase表中..…☆14Apr 6, 2013Updated 12 years ago
- 本项目主要用于搭建一个基于docker的实时监控系统，涉及的大数据相关组件有Filebeat，Kafka，Zookeeper，Flink，后端主要使用了SpringBoot进行开发，数据库使用了Redis做缓存，前端用了Vue框架，通过Ant Design组件库和Echar…☆42Jan 5, 2023Updated 3 years ago
- A simple project demonstrates the integration of Spring boot, ActiveMQ, Camel and STOMP☆11Aug 31, 2016Updated 9 years ago
- 对etcd中实现的raft算法进行注释☆11Jun 6, 2017Updated 8 years ago
- Spring-boot Oauth2 example with jwt and Redis☆12Feb 5, 2025Updated last year
- A Basic Flink Application Consuming & Aggregating Kafka Messages☆10Nov 8, 2019Updated 6 years ago
- Scripts for installing Hadoop, HBase, Hive, Pig & Spark.☆10Nov 13, 2019Updated 6 years ago
- 基于sqoop封装的一个通用的抽取工具，方便数据平台界面提交任务以及数据源管理☆10May 2, 2017Updated 8 years ago
- 汇集各类字体，包括手写体，韩文等☆11Jan 24, 2024Updated 2 years ago
- 聚合支付，融合微信+支付宝+云闪付形成形成“一码付”，业务逻辑已经完成，spring敏捷型SSM框架，多数据源，自己实现读写分离，MQ消息队列。☆14Aug 8, 2025Updated 7 months ago
- 🚀 Material-UI based Audio Player☆10Dec 2, 2022Updated 3 years ago
- POC for all the stack of big data (kafka, spark, cassandra, hdfs, docker, springboot)☆12Dec 16, 2022Updated 3 years ago
- Addax Admin is a web-based management console for Addax ETL jobs, offering task scheduling, monitoring, and data management with a Vue 3 …☆18Updated this week
- 通用机器人控制器上位机☆11Feb 10, 2021Updated 5 years ago
- EVM-compatible Cosmos Chain for scalable and interoperable DApps and smart contracts, integrating Ethereum's robust features with Cosmos'…☆12Dec 22, 2023Updated 2 years ago
- 业务规则管理系统,集成Drools,以数据库的形式实现决策表,提供动态规则配置功能☆10Nov 15, 2022Updated 3 years ago
- Hadoop, Hive, Spark, Zeppelin and Livy: all in one Docker-compose file.☆11Apr 30, 2022Updated 3 years ago
- ☆14Nov 16, 2022Updated 3 years ago
- 王道考研 操作系统 教学视频：https://www.bilibili.com/video/BV1YE411D7nH☆11Mar 20, 2021Updated 4 years ago
- 狗蛋实验室推出的智能化数据抓取、处理、分析，挖掘平台。提供美团、大众点评、饿了么、百度地图等数据。☆44Dec 24, 2018Updated 7 years ago
- 大数据学习：各种计算框架：☆11May 20, 2022Updated 3 years ago
- 1. OkHttpClient基本参数配置介绍 2. 普通GET请求（同步/异步） 3. 普通POST请求（同步/异步） 4. 根据tag取消请求 5. POST请求提交String 6. POST请求提交流 7. POST请求提交JSON（实体转JSON） 8. POST…☆12Jul 26, 2018Updated 7 years ago
- 非侵入代码的java自动分批提交数据组件☆10Nov 25, 2017Updated 8 years ago
- Lecture: Big Data☆14Oct 27, 2025Updated 4 months ago
- Netflix-Inspired Streaming App Clone (React + TypeScript + Styled Components) Experience a sleek, Netflix-style streaming platform built…☆12Jul 6, 2025Updated 8 months ago
- ☆12May 11, 2016Updated 9 years ago
- Hadoop, MapReduce, HDFS, Spark, Pig, Hive, HBase, MongoDB, Cassandra, Flume - the list goes on! Over 25 technologies.☆10Jan 1, 2018Updated 8 years ago
- flink sql☆11Jun 21, 2022Updated 3 years ago