opencore / kafka-spark-avro-exampleLinks
Example project to show how to use Kafka from Spark Streaming with the Confluent schema registry
☆11Updated 8 years ago
Alternatives and similar repositories for kafka-spark-avro-example
Users that are interested in kafka-spark-avro-example are comparing it to the libraries listed below
Sorting:
- ☆8Updated 7 years ago
- Flink Examples☆39Updated 9 years ago
- Foodmart data set in MySQL format☆10Updated last year
- Spark structured streaming with Kafka data source and writing to Cassandra☆62Updated 5 years ago
- This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.☆41Updated 8 years ago
- Kafka, Spark Streaming, Kudu integration examples☆17Updated 7 years ago
- MySQL to NoSQL real time dataflow☆18Updated 7 years ago
- Common components used across the datamountaineer kafka connect connectors☆21Updated 4 years ago
- An Apache Spark app for making data movement between Apache Hive and Apache Phoenix/HBase☆14Updated 9 years ago
- A spark sbt blueprint to build your own spark apps off of (for cloud native runtime, see the kube/spark examples)☆56Updated 6 years ago
- ☆49Updated 5 years ago
- Ambari service to deploy/manage Hortonworks IoT demo☆22Updated 8 years ago
- Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.☆20Updated 7 years ago
- POC: Spark consumer for bottledwater-pg Kafka Avro topics☆16Updated 4 years ago
- A small project to show how to add lineage to Atlas when using Spark as ETL tool☆12Updated 8 years ago
- A light Kafka to HDFS/S3 ETL library based on Apache Spark☆41Updated 8 years ago
- Schema Registry integration for Apache Spark☆40Updated 2 years ago
- Content Data Store (HDFS/HBase)☆13Updated 8 years ago
- Using Spark SQLContext, HiveContext & Spark DataFrames API with ElasticSearch, Cassandra & MongoDB☆22Updated 8 years ago
- Ambari stack for easily installing and managing Redis on HDP cluster☆14Updated 9 years ago
- Pulsar IO Kafka Connector☆24Updated 2 years ago
- Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)☆29Updated 8 years ago
- Spark cloud integration: tests, cloud committers and more☆19Updated 5 months ago
- This is an activator project for showcasing how to read & write data from Kafka-cluster using Java Producer & Consumer API.☆11Updated 8 years ago
- DataFibers Data Service☆31Updated 3 years ago
- Structured Streaming is a reference application showing how to easily integrate structured streaming Apache Spark Structured Streaming, …☆13Updated 6 years ago
- Spark 3.0.0 Structured Streaming Kafka Avro Demo☆15Updated 2 years ago
- Ansible playbook for automated HDP 2.x deployment install with Kerberos☆19Updated 8 years ago
- Read - Write JSON SerDe for Apache Hive.☆21Updated 6 years ago
- Big Data ETL and Utilities for Hadoop Map Reduce, Spark and Storm☆102Updated last year