Real-Time Analysis Integration with Kafka in Apache Spark’s Structured Streaming
☆58Mar 24, 2018Updated 8 years ago
Alternatives and similar repositories for Spark-real-time-analysis
Users that are interested in Spark-real-time-analysis are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 基于Spark的实时日志分析及异常检测系统 Flume + Kafka + Hbase + Spark-Streaming + Scala☆13Mar 12, 2019Updated 7 years ago
- ☆14Nov 3, 2016Updated 9 years ago
- Tools for building, packaging, and OAP public cloud integrations such as AWS EMR, Google Dataproc and K8S.☆18Mar 27, 2024Updated 2 years ago
- Spark* Shuffle plugin for support shuffling through remote persistent memory over fabrics, which leverages the RDMA network and remote pe…☆14Sep 18, 2023Updated 2 years ago
- spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议☆32Mar 24, 2019Updated 7 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- spark算子使用例子, spark RDD的算子挺多，有时候如何灵活的使用，该如何用一下子想不起来，这一段时间将spark的算子如何使用的例子给记录了下来，下面是spark RDD 的一些常用算子的使用 这些算子包括有java的，也有scala的语言(博客中才有)，由于精…☆35Jul 12, 2018Updated 7 years ago
- a tool help copy files from hdfs direct to ftp server☆12Dec 6, 2022Updated 3 years ago
- Spark Streaming example project which pulls messages from Kafka and write to HBase Table.☆11Jul 5, 2015Updated 10 years ago
- ☆12May 11, 2016Updated 9 years ago
- Examples of Integrating Spark Streaming, Flume, and HBase to solve Streaming problems☆19Feb 27, 2014Updated 12 years ago
- hadoop hbase use case and examples, inclusing MR,HBaseUtil...☆35Sep 18, 2013Updated 12 years ago
- A maven project with codes of the book "Hadoop: The Definitive Guide(Fourth Edition)"☆10Jul 17, 2023Updated 2 years ago
- 推荐项目（实时推荐和离线推荐）☆254Oct 24, 2017Updated 8 years ago
- Flink 流式计算框架学习笔记✨☆59Jun 21, 2022Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 特征工程利器(通过本地文件缓存, 加速特征生成)☆10Jun 17, 2023Updated 2 years ago
- ☆17Jan 7, 2020Updated 6 years ago
- Spark Streaming + kafka + hbase☆15Nov 19, 2018Updated 7 years ago
- A C++ Boosted DolphinDB Python API☆11Jun 29, 2019Updated 6 years ago
- Spark Streaming监控平台，支持任务部署与告警、自启动☆129Mar 29, 2018Updated 8 years ago
- Spark Shuffle Optimization with RDMA+AEP☆30May 23, 2023Updated 2 years ago
- SpringCloud企业级核心技术，对应简书《Spring Cloud 核心技术》专题配套源码☆16Mar 1, 2019Updated 7 years ago
- 一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目☆133Dec 17, 2025Updated 4 months ago
- 🌟 推理王国：关于 AI 推理机制的思想实验手册。从信息论、符号逻辑与表示学习出发，系统剖析大模型“智能”的本质。☆53Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- conbine flume,spark-streaming and redis for real-time computing☆22Oct 20, 2014Updated 11 years ago
- JAVA开源关键词提取框架☆10Nov 26, 2014Updated 11 years ago
- Distributed SQL base Realtime Streaming Computation Framework On Apache Storm, Spark☆12Mar 14, 2016Updated 10 years ago
- BigData Project 大数据项目由浅入深☆648Nov 30, 2017Updated 8 years ago
- Spark Streaming+Flume+Kafka+HBase+Hadoop+Zookeeper实现实时日志分析统计；SpringBoot+Echarts实现数据可视化展示☆519Jul 25, 2018Updated 7 years ago
- Spark1.6和spark2.2的示例，包含kafka,flume,structuredstreaming,jedis,elasticsearch,mysql,dataframe☆15Jan 28, 2018Updated 8 years ago
- Used to demonstrate how to use nacos-sync☆34Dec 21, 2024Updated last year
- Spark Streaming HBase Example☆22Mar 16, 2016Updated 10 years ago
- The book of data warehouse☆196Oct 13, 2022Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 数据仓库KETTLE ETL资源库☆14Jun 11, 2015Updated 10 years ago
- Use Scala API to read/write data from different databases,HBase,MySQL,etc.☆24Feb 28, 2018Updated 8 years ago
- Flink 电商指标分析系统☆38Apr 10, 2026Updated 3 weeks ago
- High Performance Spark Streaming with Direct Kafka in Java☆39Sep 14, 2016Updated 9 years ago
- Java实现网盘☆10Sep 12, 2015Updated 10 years ago
- Flume-to-Spark-Streaming Log Parser☆23Jun 3, 2016Updated 9 years ago
- A big data platform for analyzing web access logs☆54Dec 16, 2022Updated 3 years ago