SparkStreaming项目,显示flume->Kafka->Spark->hbase(实时数据处理方案),Scala实现
☆37Feb 19, 2018Updated 8 years ago
Alternatives and similar repositories for SparkStreamingProject
Users that are interested in SparkStreamingProject are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 使用spark streaming 导入kafka数据到hbase☆25Apr 14, 2016Updated 10 years ago
- spark将hdfs数据高性能灌入kafka,然后spark streaming/structured streaming高速消费,关注性能,欢迎提供性能/代码优化建议☆32Mar 24, 2019Updated 7 years ago
- SparkStreaming爱奇艺实时流统计及可视化展示☆22Sep 23, 2018Updated 7 years ago
- 四川大学拓思爱诺用户session行为数据离线分析项目☆68Jul 1, 2022Updated 4 years ago
- ☆12May 11, 2016Updated 10 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆43Aug 2, 2017Updated 9 years ago
- ☆14Nov 3, 2016Updated 9 years ago
- 主要学习大数据生态内容,一步步搭建大数据框架。☆24Aug 23, 2018Updated 8 years ago
- A shell script to automate the operations of sqoop☆11Mar 29, 2021Updated 5 years ago
- Spark Streaming+Flume+Kafka+HBase+Hadoop+Zookeeper实现 实时日志分析统计;SpringBoot+Echarts实现数据可视化展示☆516Jul 25, 2018Updated 8 years ago
- Encapsulated spark 与其他组件的结合api,方便使用,例如 es,hbase,kudu,kafka,mq等☆36Dec 18, 2019Updated 6 years ago
- Use Scala API to read/write data from different databases,HBase,MySQL,etc.☆24Feb 28, 2018Updated 8 years ago
- Streaming 相关项目☆15Mar 27, 2017Updated 9 years ago
- 大数据平台相关代码(ES/Hive/Hadoop/hdfs/hbase)☆75Nov 4, 2022Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Spark Streaming + kafka + hbase☆15Nov 19, 2018Updated 7 years ago
- 一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目☆132Dec 17, 2025Updated 8 months ago
- 基于spark streaming+flume+kafka+hbase的实时日志处理分析系统(分为控制台版本和基于springboot、Echarts等的Web UI可视化版本)☆41Jul 20, 2023Updated 3 years ago
- 基于PySpark库,使用SparkSql连接MYSQL数据库并对数据进行统计分析的基础架构☆13Apr 24, 2018Updated 8 years ago
- Spark Streaming HBase Example☆22May 20, 2026Updated 3 months ago
- 学习 Spark 的一个小项目,以及其中各种调优的笔记☆177Jul 20, 2017Updated 9 years ago
- 最好的大数据项目。《Titan数据运营系统》,本项目是一个全栈闭环系统,我们有用作数据可视化的web系统,然后用flume-kafaka-flume进行日志的读取,在hive设计数仓,编写spark代码进行数仓表之间的转化以及ads层表到mysql的迁移,使用azkaban…☆147Nov 8, 2021Updated 4 years ago
- Mecha SDK of Cloud Application Api. Let the code achieve "write once, run anywhere". With the help of the Capa project, your Java applic…☆15Jul 22, 2026Updated last month
- spark机器学习算法研究和源码分析☆29Mar 5, 2017Updated 9 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 用户画像代码,根据算法推算出用户的性别和年龄比率☆11Dec 18, 2017Updated 8 years ago
- 基于Spark的实时推荐系统,使用MovieLens作为测试数据集☆28Dec 16, 2022Updated 3 years ago
- 华为HBase普通客户端和安全模式客户端,包括建表、建索引、异步请求、Put、Get、Scan等功能☆11Jun 6, 2020Updated 6 years ago
- 基于spark streaming和kafka,hbase的日志统计分析系统☆264Sep 5, 2017Updated 8 years ago
- ☆40Aug 19, 2015Updated 11 years ago
- 基于Strom的实时流量分析防火墙系统☆12Jul 4, 2016Updated 10 years ago
- 简单的、高可用、高效的基于共享内存的分布式配置中心,集中式管理各类后台配置,配置修改实时推送,且业务API相当简单(两行搞定,一个init+一个get,见readme),已轻量级支持Golang/C++/Java/Python等语言API☆39Aug 13, 2018Updated 8 years ago
- 基于WIFI探针的商业大数据分析技术☆303Nov 16, 2022Updated 3 years ago
- A series of demos using HBase Standalone and Phoenix/HBase☆19Apr 10, 2015Updated 11 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Spark structured-streaming 消费kafka数据写入hbase☆33Jan 22, 2019Updated 7 years ago
- 大数据实践项目 Hadoop、Spark、Kafka、Hbase、Flink.....☆542May 14, 2019Updated 7 years ago
- 基于Flume、Kafka、SparkSql模拟的实时日志分析系统☆12Feb 1, 2016Updated 10 years ago
- This repository contains code for Spark Streaming☆26Mar 11, 2021Updated 5 years ago
- 以慕课网日志分析为例 进入大数据 Spark SQL 的世界☆15Apr 3, 2018Updated 8 years ago
- mybatis 入门教程☆15May 7, 2025Updated last year
- 基于spark-streaming的实时数仓☆12Jul 23, 2023Updated 3 years ago