Azure-Samples / hdinsight-spark-scala-kafkaLinks
A basic example of how to read and write streaming data using Apache Spark and Kafka on HDInsight
☆13Updated 2 years ago
Alternatives and similar repositories for hdinsight-spark-scala-kafka
Users that are interested in hdinsight-spark-scala-kafka are comparing it to the libraries listed below
Sorting:
- Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.☆20Updated 8 years ago
- Starter project for building MemSQL Streamliner Pipelines☆32Updated 8 years ago
- These are some code examples☆56Updated 6 years ago
- Dockerfile for Apache Zeppelin☆17Updated 10 years ago
- POC: Spark consumer for bottledwater-pg Kafka Avro topics☆16Updated 5 years ago
- CDAP Applications☆44Updated 7 years ago
- Example code for building your own MemSQL Streamliner Pipelines☆23Updated 8 years ago
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆62Updated last year
- ☆21Updated 10 years ago
- Real-world Spark pipelines examples☆83Updated 7 years ago
- Library for organizing batch processing pipelines in Apache Spark☆42Updated 9 years ago
- This repository is to help with the Partner Demonstration of the Apache Atlas project.☆30Updated 10 years ago
- Docker Image and Kubernetes Configurations for Spark 2.x☆41Updated 6 years ago
- Cascading on Apache Flink®☆54Updated last year
- type-class based data cleansing library for Apache Spark SQL☆78Updated 6 years ago
- Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌☆29Updated 5 years ago
- Examples for Fast Data Processing with Spark☆59Updated 12 years ago
- functionstest☆33Updated 9 years ago
- A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.☆47Updated 9 years ago
- Schema Registry integration for Apache Spark☆40Updated 3 years ago
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆73Updated 4 years ago
- Use Cascading Taps and Scalding DSL with Spark☆49Updated 9 years ago
- An umbrella project for multiple implementations of model serving☆45Updated 8 years ago
- Common components used across the datamountaineer kafka connect connectors☆21Updated 4 years ago
- Pipelines Example Applications☆14Updated 6 years ago
- Spooker is a dynamic framework for processing high volume data streams via processing pipelines☆30Updated 9 years ago
- Scalable CDC Pattern Implemented using PySpark☆18Updated 3 months ago
- Spark with Scala example projects☆34Updated 6 years ago
- Interactive Audience Analytics with Spark and HyperLogLog☆55Updated 10 years ago
- Experiments with the GDELT dataset and Cassandra schemas.☆25Updated 9 years ago