Neuw84 / structured-streaming-avro-demo
Spark 3.0.0 Structured Streaming Kafka Avro Demo
☆15Updated last year
Alternatives and similar repositories for structured-streaming-avro-demo:
Users that are interested in structured-streaming-avro-demo are comparing it to the libraries listed below
- Spark structured streaming with Kafka data source and writing to Cassandra☆62Updated 5 years ago
- A light Kafka to HDFS/S3 ETL library based on Apache Spark☆41Updated 7 years ago
- A sink to save Spark Structured Streaming DataFrame into Hive table☆23Updated 6 years ago
- High performance HBase / Spark SQL engine☆28Updated 2 years ago
- Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)☆29Updated 8 years ago
- Spark code to analyze HBase Snapshots☆34Updated 7 years ago
- Spark Streaming HBase Example☆22Updated 9 years ago
- Kafka, Spark Streaming, Kudu integration examples☆17Updated 7 years ago
- Build configuration-driven ETL pipelines on Apache Spark☆159Updated 2 years ago
- Spark SQL UDF examples☆56Updated 7 years ago
- Scalable CDC Pattern Implemented using PySpark☆18Updated 5 years ago
- Spark Example using Phoenix to interact with HBase☆16Updated 8 years ago
- This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.☆41Updated 8 years ago
- Java library to integrate Flink and Kudu☆54Updated 7 years ago
- Apache Spark and Apache Kafka integration example☆124Updated 7 years ago
- Kafka Connect to Hbase☆43Updated 4 years ago
- ElasticSearch integration for Apache Spark☆47Updated 8 years ago
- Examples of Spark 3.0☆47Updated 4 years ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- Sample processing code using Spark 2.1+ and Scala☆51Updated 4 years ago
- Big Data ETL and Utilities for Hadoop Map Reduce, Spark and Storm☆103Updated last year
- Spark Streaming HBase Example☆95Updated 8 years ago
- This is a datasource implementation for quick query in Kafka with Spark☆9Updated last year
- Plugin for Presto to allow addition of user functions easily☆116Updated 3 years ago
- Schema Registry integration for Apache Spark☆40Updated 2 years ago
- A small project to show how to add lineage to Atlas when using Spark as ETL tool☆12Updated 8 years ago
- ☆8Updated 6 years ago
- A library based on delta for Spark and MLSQL☆61Updated 4 years ago
- Based off the design of SparkOnHBase. This Repo will support Spark, Spark Streaming, and Spark SQL integration with Kudu.☆50Updated 8 years ago
- ☆39Updated 3 years ago