SparkStreaming项目，显示flume->Kafka->Spark->hbase(实时数据处理方案)，Scala实现
☆36Feb 19, 2018Updated 8 years ago
Alternatives and similar repositories for SparkStreamingProject
Users that are interested in SparkStreamingProject are comparing it to the libraries listed below
Sorting:
- 四川大学拓思爱诺用户session行为数据离线分析项目☆68Jul 1, 2022Updated 3 years ago
- 基于Spark2.2新闻网大数据实时系统项目☆62Apr 3, 2019Updated 6 years ago
- 主要学习大数据生态内容，一步步搭建大数据框架。☆24Aug 23, 2018Updated 7 years ago
- ☆14Nov 3, 2016Updated 9 years ago
- ☆12May 11, 2016Updated 9 years ago
- 使用spark streaming 导入kafka数据到hbase☆25Apr 14, 2016Updated 9 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆44Aug 2, 2017Updated 8 years ago
- spark流数据处理，可以从flume-ng，kafka接收数据☆11Sep 16, 2015Updated 10 years ago
- Spark Streaming example project which pulls messages from Kafka and write to HBase Table.☆11Jul 5, 2015Updated 10 years ago
- Mecha SDK of Cloud Application Api. Let the code achieve "write once, run anywhere". With the help of the Capa project, your Java applic…☆14Aug 19, 2024Updated last year
- 大数据平台相关代码（ES/Hive/Hadoop/hdfs/hbase）☆74Nov 4, 2022Updated 3 years ago
- SparkStreaming爱奇艺实时流统计及可视化展示☆22Sep 23, 2018Updated 7 years ago
- spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议☆32Mar 24, 2019Updated 6 years ago
- 基于PySpark库，使用SparkSql连接MYSQL数据库并对数据进行统计分析的基础架构☆14Apr 24, 2018Updated 7 years ago
- Spark Streaming + kafka + hbase☆15Nov 19, 2018Updated 7 years ago
- sparkStreaming项目，1.日志分析系统 2. 舆情管控系统之实时词频统计处理子系统（包括中文分词服务器）3. 网站用户行为统计系统（ 只统计用户行为，建模预测后期实现） 4. 网站安全实时监控报警系统。☆14Jul 1, 2022Updated 3 years ago
- 根据数据表结构,自动生成Model&Mapper&Service&ServiceImpl&Controller代码☆15Oct 2, 2019Updated 6 years ago
- Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等☆35Dec 18, 2019Updated 6 years ago
- spark streaming从kafka读取消息，offset写入Redis，spark计算单词出现频率，最后写入hive表☆17Jul 30, 2019Updated 6 years ago
- Streaming 相关项目☆15Mar 27, 2017Updated 8 years ago
- Spark Streaming+Flume+Kafka+HBase+Hadoop+Zookeeper实现实时日志分析 统计；SpringBoot+Echarts实现数据可视化展示☆520Jul 25, 2018Updated 7 years ago
- 基于spark streaming+flume+kafka+hbase的实时日志处理分析系统(分为控制台版本和基于springboot、Echarts等的Web UI可视化版本)☆39Jul 20, 2023Updated 2 years ago
- mybatis 入门教程☆15May 7, 2025Updated 9 months ago
- BlockchainGPT: An intuitive, chat-based platform to manage your blockchain environments using natural language processing capabilities.☆11Jul 6, 2023Updated 2 years ago
- Vrml is a high-level abstract API library for application runtime. The next goal of Vrml is to migrate to cloud-runtimes, become an imple…☆19Sep 9, 2025Updated 5 months ago
- study demos for hadoop、hbase、hive、spark、storm .......☆16Mar 9, 2016Updated 9 years ago
- docker-hadoop-spark-hive 快速构建你的大数据环境☆21Jan 4, 2020Updated 6 years ago
- Use Scala API to read/write data from different databases,HBase,MySQL,etc.☆24Feb 28, 2018Updated 8 years ago
- A simple reproducible template to implement AI research papers☆24Sep 9, 2024Updated last year
- 一个基于Softflowd，Kafka，Spark Streaming，Elk，Django开发的网络数据流监控分析后台， 支持Netflow V9与Netflow V5。可以对进入和流出的流量进行异常分析并执行自动化漏洞修复。☆25Jun 10, 2021Updated 4 years ago
- leetcode刷题记录，java☆25Apr 16, 2018Updated 7 years ago
- 使用spark对hive、hbase、ES的读写， 实现一次配置可对不同数据库进行导入导出，并对ES、hbase进行封装☆33May 6, 2017Updated 8 years ago
- 自助搭建的 hadoop + spark + kafka + zookeeper + storm + hbase + hive + flume 集群，一主两从。☆31Jan 16, 2019Updated 7 years ago
- 最好的大数据项目。《Titan数据运营系统》，本项目是一个全栈闭环系统，我们有用作数据可视化的web系统，然后用flume-kafaka-flume进行日志的读取，在hive设计数仓，编写spark代码进行数仓表之间的转化以及ads层表到mysql的迁移，使用azkaban…☆143Nov 8, 2021Updated 4 years ago
- Spark structured-streaming 消费kafka数据写入hbase☆33Jan 22, 2019Updated 7 years ago
- 排班管理系统☆11Jul 15, 2015Updated 10 years ago
- Python基于YOLO＆Deepsort的闯红灯检测系统（完整源码＆自定义UI操作界面＆视频教程）☆17Nov 18, 2023Updated 2 years ago
- 基于Spark的实时推荐系统,使用MovieLens作为测试数据集☆28Dec 16, 2022Updated 3 years ago
- 项目实战：Hadoop生态圈☆31Feb 27, 2018Updated 8 years ago