SparkStreaming项目，显示flume->Kafka->Spark->hbase(实时数据处理方案)，Scala实现
☆36Feb 19, 2018Updated 8 years ago
Alternatives and similar repositories for SparkStreamingProject
Users that are interested in SparkStreamingProject are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- spark流数据处理，可以从flume-ng，kafka接收数据☆11Sep 16, 2015Updated 10 years ago
- 使用spark streaming 导入kafka数据到hbase☆25Apr 14, 2016Updated 10 years ago
- spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议☆32Mar 24, 2019Updated 7 years ago
- SparkStreaming爱奇艺实时流统计及可视化展示☆22Sep 23, 2018Updated 7 years ago
- 四川大学拓思爱诺用户session行为数据离线分析项目☆68Jul 1, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- sparkStreaming项目，1.日志分析系统 2. 舆情管控系统之实时词频统计处理子系统（包括中文分词服务器）3. 网站用户行为统计系统（ 只统计用户行为，建模预测后期实现） 4. 网站安全实时监控报警系统。☆14Jul 1, 2022Updated 3 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆43Aug 2, 2017Updated 8 years ago
- ☆14Nov 3, 2016Updated 9 years ago
- 主要学习大数据生态内容，一步步搭建大数据框架。☆24Aug 23, 2018Updated 7 years ago
- Spark Streaming example project which pulls messages from Kafka and write to HBase Table.☆11Jul 5, 2015Updated 10 years ago
- ☆12May 11, 2016Updated 10 years ago
- 基于Spark2.2新闻网大数据实时系统项目☆62Apr 3, 2019Updated 7 years ago
- Spark Streaming+Flume+Kafka+HBase+Hadoop+Zookeeper实现实时日志分析统计；SpringBoot+Echarts实现数据可视化展示☆519Jul 25, 2018Updated 7 years ago
- Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等☆36Dec 18, 2019Updated 6 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Use Scala API to read/write data from different databases,HBase,MySQL,etc.☆24Feb 28, 2018Updated 8 years ago
- Streaming 相关项目☆15Mar 27, 2017Updated 9 years ago
- A shell script to automate the operations of sqoop☆11Mar 29, 2021Updated 5 years ago
- 大数据平台相关代码（ES/Hive/Hadoop/hdfs/hbase）☆74Nov 4, 2022Updated 3 years ago
- Spark Streaming + kafka + hbase☆15Nov 19, 2018Updated 7 years ago
- 基于spark streaming+flume+kafka+hbase的实时日志处理分析系统(分为控制台版本和基于springboot、Echarts等的Web UI可视化版本)☆41Jul 20, 2023Updated 2 years ago
- Spark Streaming HBase Example☆22Mar 16, 2016Updated 10 years ago
- 基于PySpark库，使用SparkSql连接MYSQL数据库并对数据进行统计分析的基础架构☆14Apr 24, 2018Updated 8 years ago
- Examples of Integrating Spark Streaming, Flume, and HBase to solve Streaming problems☆19Feb 27, 2014Updated 12 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 学习 Spark 的一个小项目，以及其中各种调优的笔记☆177Jul 20, 2017Updated 8 years ago
- 最好的大数据项目。《Titan数据运营系统》，本项目是一个全栈闭环系统，我们有用作数据可视化的web系统，然后用flume-kafaka-flume进行日志的读取，在hive设计数仓，编写spark代码进行数仓表之间的转化以及ads层表到mysql的迁移，使用azkaban…☆144Nov 8, 2021Updated 4 years ago
- Mecha SDK of Cloud Application Api. Let the code achieve "write once, run anywhere". With the help of the Capa project, your Java applic…☆14Mar 21, 2026Updated 2 months ago
- A maven project with codes of the book "Hadoop: The Definitive Guide(Fourth Edition)"☆10Jul 17, 2023Updated 2 years ago
- Advanced Analytics with Spark (Spark高级数据分析) 书中的Scala代码,此项目中将其也转换为Java代码☆11Jun 20, 2017Updated 8 years ago
- spark机器学习算法研究和源码分析☆31Mar 5, 2017Updated 9 years ago
- 酒店后台管理系统（采用SSH框架开发），这个项目这要有四个功能模块。模拟酒店的正常员工的工作性质：前台、保 洁、后厨、经理。前台主要是负责完成客户入住酒店的时候完成客户信息的注册、预定酒店房间的信息注册和客户预定餐饮的订单信息注册。保洁主要是在客户到前台退房后，收到前台通知“…☆14May 30, 2019Updated 6 years ago
- 基于Spark的实时推荐系统,使用MovieLens作为测试数据集☆28Dec 16, 2022Updated 3 years ago
- 基于Strom的实时流量分析防火墙系统☆12Jul 4, 2016Updated 9 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 简单的、高可用、高效的基于共享内存的分布式配置中心，集中式管理各类后台配置，配置修改实时推送，且业务API相当简单（两行搞定，一个init+一个get，见readme），已轻量级支持Golang/C++/Java/Python等语言API☆40Aug 13, 2018Updated 7 years ago
- Scala练习项目：包括scala基础知识，Spark RDD，DataFrame，Spark SQL，spark与HDFS、Phoenix、Hbase交互。☆12Nov 11, 2022Updated 3 years ago
- ☆39Aug 19, 2015Updated 10 years ago
- Example for TWAS☆12Jan 23, 2022Updated 4 years ago
- Big Data☆10Jun 15, 2023Updated 2 years ago
- 基于WIFI探针的商业大数据分析技术☆301Nov 16, 2022Updated 3 years ago
- leetcode刷题记录，java☆25Apr 16, 2018Updated 8 years ago