jerryshao / spark-hive-streaming-sink
A sink to save Spark Structured Streaming DataFrame into Hive table
☆31Updated 6 years ago
Related projects: ⓘ
- A library based on delta for Spark and MLSQL☆61Updated 3 years ago
- Java library to integrate Flink and Kudu☆53Updated 7 years ago
- A playground for Spark jobs.☆44Updated 5 years ago
- 已经合入(apache/incubator-kyuubi) ACL Management for Apache Spark SQL with Apache Ranger.☆54Updated 2 years ago
- spark将hdfs数据高性能灌入kafka,然后spark streaming/structured streaming高速消费,关注性能,欢迎提供性能/代码优化建议☆33Updated 5 years ago
- Spark code to analyze HBase Snapshots☆34Updated 6 years ago
- SparkSQL自定义Hint优化器解决热点数据导致JOIN数据倾斜问题☆48Updated 5 years ago
- sql实现Structured Streaming☆39Updated 5 years ago
- fast spark local mode☆35Updated 6 years ago
- This is a library for SQL optimizing/rewriting including Materialized View rewrite☆67Updated 2 years ago
- A library for querying Binlog with Apache Spark structure streaming, for Spark SQL , DataFrames and [MLSQL](https://www.mlsql.tech).☆154Updated last year
- PostgreSQL and GreenPlum Data Source for Apache Spark☆35Updated 6 months ago
- DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management☆61Updated 8 years ago
- Spark Streaming HBase Example☆96Updated 8 years ago
- A sink to save Spark Structured Streaming DataFrame into Hive table☆23Updated 6 years ago
- Demo for service oriented application hosted on Hadoop YARN cluster for HA and scheduling☆23Updated 6 years ago
- My Blog☆76Updated 6 years ago
- Spark Structured Streaming Kafka 0.8 Source Implementation☆35Updated 7 years ago
- Hive on Kudu☆20Updated 5 years ago
- Learn how to use Spark SQL and HSpark connector package to create / query data tables that reside in HBase region servers☆69Updated last year
- Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …☆37Updated 7 years ago
- Apache Phoenix Connectors☆50Updated this week
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆45Updated 7 years ago
- 一个为spark批量导入数据到hbase的库☆43Updated 7 years ago
- Spark 脚手架工程,标准化 spark 开发、部署、测试流程。☆93Updated last year
- ☆40Updated 2 years ago
- ☆33Updated 5 years ago
- Custom datasource about spark structure streaming☆14Updated 5 years ago
- A Spark SQL HBase connector☆29Updated 9 years ago
- Project to create configurable ETL via lightbend configuration using Spark Structured Streaming☆8Updated 6 years ago