Azure-Samples / hdinsight-spark-scala-kafka
A basic example of how to read and write streaming data using Apache Spark and Kafka on HDInsight
☆13Updated 2 years ago
Alternatives and similar repositories for hdinsight-spark-scala-kafka:
Users that are interested in hdinsight-spark-scala-kafka are comparing it to the libraries listed below
- Starter project for building MemSQL Streamliner Pipelines☆32Updated 7 years ago
- Use cases built on SnappyData. Use cases contained here: 1. Ad Analytics 2. Streaming data ingestion from RabbitMQ.☆32Updated 2 years ago
- Avro Schema Shredder is a REST API that enables storage of Avro Schemas in Apache Atlas. This API enables an organization to use Apache A…☆13Updated 8 years ago
- Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.☆18Updated 7 years ago
- ☆21Updated 9 years ago
- Java code for Apache Nifi processors☆11Updated 7 years ago
- Common components used across the datamountaineer kafka connect connectors☆21Updated 4 years ago
- Sample custom Nifi processor to process tcpdump☆18Updated 9 years ago
- Spark pipelines that correspond to a series of Dataflow examples.☆27Updated 5 years ago
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆50Updated last year
- A collection of datasets and databases☆24Updated 6 years ago
- POC: Spark consumer for bottledwater-pg Kafka Avro topics☆16Updated 4 years ago
- This is a mirror of https://github.com/LucaCanali/sparkMeasure - sparkMeasure is a tool for performance troubleshooting of Apache Spark w…☆14Updated 11 months ago
- A generator for synthetic streams of financial transactions.☆16Updated 11 years ago
- Docker Image and Kubernetes Configurations for Spark 2.x☆41Updated 5 years ago
- Utilities for writing tests that use Apache Spark.☆24Updated 6 years ago
- These are some code examples☆55Updated 5 years ago
- A single docker image that combines Neo4j Mazerunner and Apache Spark GraphX into a powerful all-in-one graph processing engine☆46Updated 5 years ago
- ☆10Updated 9 years ago
- phData Pulse application log aggregation and monitoring☆13Updated 4 years ago
- Google Cloud Dataflow pipelines such as Identity-By-State as well as useful utility classes.☆37Updated last year
- functionstest☆33Updated 8 years ago
- Cascading on Apache Flink®☆54Updated last year
- Ansible playbook for automated HDP 2.x deployment install with Kerberos☆19Updated 8 years ago
- HDF masterclass materials☆28Updated 8 years ago
- Examples for Fast Data Processing with Spark☆59Updated 11 years ago
- Scalable CDC Pattern Implemented using PySpark☆18Updated 5 years ago
- Flink Examples☆39Updated 8 years ago
- type-class based data cleansing library for Apache Spark SQL☆79Updated 5 years ago
- Sketching data structures for scala, including t-digest☆15Updated 3 years ago