LinMingQiang/spark-utils external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

LinMingQiang/spark-utils

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/LinMingQiang/spark-utils)

Close

LinMingQiang / spark-utilsView on GitHubMore

• External links
• Readme badge

Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等

☆36Dec 18, 2019Updated 6 years ago

Alternatives and similar repositories for spark-utils

Users that are interested in spark-utils are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• LinMingQiang / sparkstreaming

  View on GitHub
  封装sparkstreaming动态调节batch time(有数据就执行计算)； 支持运行过程中增删topic； 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。
  ☆181Apr 15, 2021Updated 5 years ago
• LinMingQiang / flink-learn

  View on GitHub
  Learning Flink : Flink CEP,Flink Core,Flink SQL
  ☆73Feb 21, 2022Updated 4 years ago
• gh-gan / SparkStreaming

  View on GitHub
  Streaming 相关项目
  ☆15Mar 27, 2017Updated 9 years ago
• LinMingQiang / face-recognition_java

  View on GitHub
  java 人脸识别; Face recognition
  ☆14Aug 20, 2018Updated 7 years ago
• SelfEvoAI / sparkStreamingKafkaPerformance

  View on GitHub
  spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议
  ☆32Mar 24, 2019Updated 7 years ago
• Managed hosting for WordPress and PHP on Cloudways • Ad
  Managed hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
• allwefantasy / spark-hbase

  View on GitHub
  A HBase datasource implementation for Spark and [MLSQL](http://www.mlsql.tech).
  ☆15Sep 29, 2023Updated 2 years ago
• ikexu / SparkStreaming-Use-OpenCV

  View on GitHub
  Spark Streaming与OpenCV传感器数据实时获取
  ☆13Jun 20, 2016Updated 9 years ago
• NashTech-Labs / structured-streaming-application

  View on GitHub
  Structured Streaming is a reference application showing how to easily integrate structured streaming Apache Spark Structured Streaming, …
  ☆13Nov 17, 2018Updated 7 years ago
• polomarcus / Spark-Structured-Streaming-Examples

  View on GitHub
  Spark Structured Streaming / Kafka / Cassandra / Elastic
  ☆186Feb 7, 2023Updated 3 years ago
• E-SoulDataGroup / spark_streaming_kafka_offset

  View on GitHub
  SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失
  ☆43Aug 2, 2017Updated 8 years ago
• OopsOutOfMemory / spark-sql-hbase

  View on GitHub
  A Spark SQL HBase connector
  ☆29May 4, 2015Updated 11 years ago
• pdaodao / fiflow

  View on GitHub
  flink-sql 在 flink 上运行 sql 和 构建数据流的平台 基于 apache flink 1.10.0
  ☆113Jun 21, 2022Updated 3 years ago
• TopSpoofer / kafka-spark-streaming-to-hbase

  View on GitHub
  使用spark streaming 导入kafka数据到hbase
  ☆25Apr 14, 2016Updated 10 years ago
• tokings / springboot-spark-thrift

  View on GitHub
  此工程采用SpringBoot + Mybatis + SparkSQL + Hive框架进行集成，支持Kerberos认证。
  ☆21Mar 19, 2018Updated 8 years ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• xieenze / SparkOnKudu

  View on GitHub
  使用spark + kudu的案例
  ☆15Sep 13, 2017Updated 8 years ago
• 344399160 / sparkForDB

  View on GitHub
  使用spark对hive、hbase、ES的读写， 实现一次配置可对不同数据库进行导入导出，并对ES、hbase进行封装
  ☆32May 6, 2017Updated 9 years ago
• wengbenjue / spark_recomend

  View on GitHub
  使用Spark的MLlib、Hbase作为模型、Hive作数据清洗的核心推荐引擎,在Spark on Yarn测试通过
  ☆30Mar 9, 2017Updated 9 years ago
• SelfEvoAI / kudu-learning

  View on GitHub
  kudu学习的一些资料，以及和spark/impala的集成使用
  ☆34Sep 11, 2017Updated 8 years ago
• jerryshao / spark-hive-streaming-sink

  View on GitHub
  A sink to save Spark Structured Streaming DataFrame into Hive table
  ☆29Apr 16, 2018Updated 8 years ago
• lttoto / SparkStreamingProject

  View on GitHub
  SparkStreaming项目，显示flume->Kafka->Spark->hbase(实时数据处理方案)，Scala实现
  ☆36Feb 19, 2018Updated 8 years ago
• elevy30 / bigdata-playground

  View on GitHub
  POC for all the stack of big data (kafka, spark, cassandra, hdfs, docker, springboot)
  ☆12Dec 16, 2022Updated 3 years ago
• tygxy / StreamingDemo

  View on GitHub
  Spark Streaming + kafka + hbase
  ☆15Nov 19, 2018Updated 7 years ago
• opensourceteams / flink-maven-scala

  View on GitHub
  flink技术学习笔记分享
  ☆81Mar 16, 2019Updated 7 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• pchanumolu / Spark-Streaming-Apache-Kafka-Apache-HBase

  View on GitHub
  Spark Streaming example project which pulls messages from Kafka and write to HBase Table.
  ☆11Jul 5, 2015Updated 10 years ago
• seawaylee / spark-rec-v2

  View on GitHub
  Spark混合推荐系统大数据监控平台
  ☆11May 1, 2018Updated 8 years ago
• dtinfor / dqcenter

  View on GitHub
  基于PowerCenter的数据质量监控系统
  ☆13Dec 27, 2017Updated 8 years ago
• Gschiavon / Kafka-SparkStreaming-HDFS

  View on GitHub
  ☆14Nov 3, 2016Updated 9 years ago
• GuoNingNing / fire-spark

  View on GitHub
  Spark 脚手架工程，标准化 spark 开发、部署、测试流程。
  ☆93Oct 10, 2024Updated last year
• liuyatao / spring_security_verifycode

  View on GitHub
  一个Spring Security添加验证码的示例
  ☆11Sep 3, 2017Updated 8 years ago
• zhenu14 / recommender

  View on GitHub
  SpringBoot + Apache Mahout 推荐引擎 基于用户评分数据推荐相关电影
  ☆11Jun 7, 2018Updated 7 years ago
• wangliangbd / SparkStreaming_Store_KafkaTopicOffset_To_HBase

  View on GitHub
  Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …
  ☆37Apr 19, 2017Updated 9 years ago
• zaratsian / SparkPhoenix

  View on GitHub
  Spark Example using Phoenix to interact with HBase
  ☆16Nov 2, 2016Updated 9 years ago
• Deploy to Railway using AI coding agents - Free Credits Offer • Ad
  Use Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
• singgel / BigData-skillTree

  View on GitHub
  【易车】- Spark、flink、HBase、Hive、flume集成了一些Hadoop的原生api的一些demo（如HDFS、MapReduce：目前就这两个）；同时测试一些异常功能
  ☆16Apr 4, 2019Updated 7 years ago
• zgl1011 / canal-kafka-hbase

  View on GitHub
  基于canal.deployer-1.1.1-SNAPSHOT.tar，canal连接kafka，springboot消费kafka数据入hbase和ElasticSearch
  ☆15Dec 19, 2018Updated 7 years ago
• yangtong123 / StudySpark

  View on GitHub
  学习 Spark 的一个小项目，以及其中各种调优的笔记
  ☆177Jul 20, 2017Updated 8 years ago
• hongs01 / ltybdservice-root

  View on GitHub
  蓝泰源大数据基础平台
  ☆17Mar 7, 2018Updated 8 years ago
• springMoon / sqlSubmit

  View on GitHub
  基于 Flink 的 sqlSubmit 程序
  ☆145May 12, 2026Updated last week
• vbay / rubick

  View on GitHub
  拉比克是一个开源大数据平台构建方案，已稳定应用于生产集群。融合Hadoop、Hive、Hbase、zookeeper等如CDH
  ☆14Mar 11, 2019Updated 7 years ago
• duhanmin / kafka-flink-hbase

  View on GitHub
  flink实时处理kafka传来的数据通过连接池技术写入hbase
  ☆95Jul 18, 2022Updated 3 years ago