Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等
☆35Dec 18, 2019Updated 6 years ago
Alternatives and similar repositories for spark-utils
Users that are interested in spark-utils are comparing it to the libraries listed below
Sorting:
- 封装sparkstreaming动态调节batch time(有数据就执行计算)； 支持运行过程中增删topic； 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。☆182Apr 15, 2021Updated 4 years ago
- Learning Flink : Flink CEP,Flink Core,Flink SQL☆73Feb 21, 2022Updated 4 years ago
- java 人脸识别; Face recognition☆14Aug 20, 2018Updated 7 years ago
- A HBase datasource implementation for Spark and [MLSQL](http://www.mlsql.tech).☆15Sep 29, 2023Updated 2 years ago
- spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议☆32Mar 24, 2019Updated 6 years ago
- Streaming 相关项目☆15Mar 27, 2017Updated 8 years ago
- 此工程采用SpringBoot + Mybatis + SparkSQL + Hive框架进行集成，支持Kerberos认证。☆21Mar 19, 2018Updated 7 years ago
- POC for all the stack of big data (kafka, spark, cassandra, hdfs, docker, springboot)☆12Dec 16, 2022Updated 3 years ago
- ☆14Nov 3, 2016Updated 9 years ago
- Structured Streaming is a reference application showing how to easily integrate structured streaming Apache Spark Structured Streaming, …☆13Nov 17, 2018Updated 7 years ago
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆186Feb 7, 2023Updated 3 years ago
- 使用spark streaming 导入kafka数据到hbase☆25Apr 14, 2016Updated 9 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆44Aug 2, 2017Updated 8 years ago
- Spark Streaming与OpenCV传感器数据实时获取☆13Jun 20, 2016Updated 9 years ago
- SpringBoot + Apache Mahout 推荐引擎 基于用户评分数据推荐 相关电影☆11Jun 7, 2018Updated 7 years ago
- 使用容器搭建大数据架构微服务☆13Nov 28, 2017Updated 8 years ago
- Spark Streaming example project which pulls messages from Kafka and write to HBase Table.☆11Jul 5, 2015Updated 10 years ago
- A Spark SQL HBase connector☆29May 4, 2015Updated 10 years ago
- 使用spark对hive、hbase、ES的读写， 实现一次配置可对不同数据库进行导入导出，并对ES、hbase进行封装☆33May 6, 2017Updated 8 years ago
- 基于PowerCenter的数据质量监控系统☆13Dec 27, 2017Updated 8 years ago
- flink-sql 在 flink 上运行 sql 和 构建数据流的平台 基于 apache flink 1.10.0☆111Jun 21, 2022Updated 3 years ago
- 使用Spark的MLlib、Hbase作为模型、Hive作数据清洗的核心推荐引擎,在Spark on Yarn测试通过☆30Mar 9, 2017Updated 8 years ago
- flink技术学习笔记分享☆81Mar 16, 2019Updated 6 years ago
- Spark RDD to read, write and delete from HBase☆273Jan 22, 2021Updated 5 years ago
- Kafka, Spark Streaming, Kudu integration examples☆17Dec 22, 2017Updated 8 years ago
- 拉比克是一个开源大数据平台构建方案，已稳定应用于生产集群。融合Hadoop、Hive、Hbase、zookeeper等如CDH☆14Mar 11, 2019Updated 6 years ago
- 全套大数据基础学习教程，包含最基础的centos、maven。大数据主要包含hdfs、mr、yarn、hbase、kafka、scala、sparkcore、sparkstreaming、sparksql。教程包含所有的源代码演示以及在线文档说明。☆54Oct 4, 2022Updated 3 years ago
- 基于canal.deployer-1.1.1-SNAPSHOT.tar，canal连接kafka，springboot消费kafka数据入hbase和ElasticSearch☆15Dec 19, 2018Updated 7 years ago
- Spark structured-streaming 消费kafka数据写入hbase☆33Jan 22, 2019Updated 7 years ago
- A sink to save Spark Structured Streaming DataFrame into Hive table☆30Apr 16, 2018Updated 7 years ago
- flink实时处理kafka传来的数据通过连接池技术写入hbase☆95Jul 18, 2022Updated 3 years ago
- Spark 脚手架工程，标准化 spark 开发、部署、测试流程。☆94Oct 10, 2024Updated last year
- 【易车】- Spark、flink、HBase、Hive、flume集成了一些Hadoop的原生api的一些demo（如HDFS、MapReduce：目前就这两个）；同时测试一些异常功能☆16Apr 4, 2019Updated 6 years ago
- Spark Streaming + kafka + hbase☆15Nov 19, 2018Updated 7 years ago
- Spark Streaming HBase Example☆94Apr 4, 2016Updated 9 years ago
- Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …☆37Apr 19, 2017Updated 8 years ago
- 学习 Spark 的一个小项目，以及其中各种调优的笔记☆177Jul 20, 2017Updated 8 years ago
- kudu学习的一些资料，以及和spark/impala的集成使用☆33Sep 11, 2017Updated 8 years ago
- 使用spark + kudu的案例☆15Sep 13, 2017Updated 8 years ago