Azure-Samples / hdinsight-spark-scala-kafka
A basic example of how to read and write streaming data using Apache Spark and Kafka on HDInsight
☆13Updated last year
Alternatives and similar repositories for hdinsight-spark-scala-kafka:
Users that are interested in hdinsight-spark-scala-kafka are comparing it to the libraries listed below
- Starter project for building MemSQL Streamliner Pipelines☆32Updated 7 years ago
- Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.☆18Updated 7 years ago
- These are some code examples☆55Updated 5 years ago
- Spark pipelines that correspond to a series of Dataflow examples.☆27Updated 5 years ago
- ☆48Updated 4 years ago
- Docker Image and Kubernetes Configurations for Spark 2.x☆41Updated 5 years ago
- ☆21Updated 9 years ago
- Schema Registry integration for Apache Spark☆40Updated 2 years ago
- This project describes how to write full ETL data pipeline using spark.☆15Updated 2 years ago
- Cascading on Apache Flink®☆54Updated 11 months ago
- Microsoft Azure Data Lake Store Filesystem Library for Java☆20Updated 2 years ago
- Utilities to help HBase as a service in HDInsight Azure☆14Updated last year
- functionstest☆33Updated 8 years ago
- Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌☆28Updated 4 years ago
- Nested Data (JSON/AVRO/XML) Parsing and Flattening in Spark☆16Updated last year
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆49Updated last year
- Cloudbreak Deployer Tool☆34Updated last year
- Flink Examples☆39Updated 8 years ago
- Utilities for writing tests that use Apache Spark.☆24Updated 6 years ago
- Examples for Fast Data Processing with Spark☆59Updated 11 years ago
- Random implementation notes☆33Updated 11 years ago
- Example code for building your own MemSQL Streamliner Pipelines☆23Updated 7 years ago
- Avro Schema Shredder is a REST API that enables storage of Avro Schemas in Apache Atlas. This API enables an organization to use Apache A…☆13Updated 8 years ago
- HDF masterclass materials☆28Updated 8 years ago
- Spark stream from kafka(json) to s3(parquet)☆15Updated 6 years ago
- A collection of datasets and databases☆24Updated 6 years ago
- Common components used across the datamountaineer kafka connect connectors☆21Updated 3 years ago
- A simple Twitter-Streaming Application for Apache Flink☆21Updated 9 years ago
- Simple Spark app that reads and writes Avro data☆31Updated 9 years ago
- Single view demo☆14Updated 8 years ago