bkvarda / iot_demo
Demo showcasing Spark Streaming, Kafka, Kudu - all in Python
☆27Updated 7 years ago
Alternatives and similar repositories for iot_demo:
Users that are interested in iot_demo are comparing it to the libraries listed below
- This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.☆41Updated 8 years ago
- Kafka, Spark Streaming, Kudu integration examples☆17Updated 7 years ago
- A light Kafka to HDFS/S3 ETL library based on Apache Spark☆41Updated 7 years ago
- Spark SQL UDF examples☆56Updated 7 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆63Updated 5 years ago
- Spark Streaming HBase Example☆22Updated 8 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)☆29Updated 8 years ago
- Spark Streaming HBase Example☆95Updated 8 years ago
- Spark 3.0.0 Structured Streaming Kafka Avro Demo☆15Updated last year
- Java Client of the Spark Job Server implementing the arranged Rest APIs☆51Updated 3 years ago
- Learn how to use Spark SQL and HSpark connector package to create / query data tables that reside in HBase region servers☆69Updated 2 years ago
- HDF masterclass materials☆28Updated 8 years ago
- Collection of examples integrating NiFi with stream process frameworks.☆56Updated 8 years ago
- ☆105Updated 5 years ago
- ☆41Updated 8 years ago
- Get started with Apache Beam and Flink☆43Updated 8 years ago
- Multi docker container images for main Big Data Tools. (Hadoop, Spark, Kafka, HBase, Cassandra, Zookeeper, Zeppelin, Drill, Flink, Hive, …☆34Updated last month
- Code repository for the book - Mastering Flink by Tanmay Deshpande☆74Updated 7 years ago
- A modern real-time streaming application serving as a reference framework for developing a big data pipeline, complete with a broad range…☆41Updated 4 years ago
- Example project showing how to use Hive UDFs in Apache Spark☆55Updated 5 years ago
- Simple examle for Spark Streaming over Kafka topic☆106Updated 4 years ago
- A bridge to Apache Atlas for provenance metadata created in course of using Apache NiFi☆15Updated 2 years ago
- Self-contained examples of Apache Spark streaming integrated with Apache Kafka.☆199Updated 6 years ago
- Structured Streaming Machine Learning example with Spark 2.0☆92Updated 7 years ago
- spark + drools☆102Updated 2 years ago
- Using Spark SQLContext, HiveContext & Spark DataFrames API with ElasticSearch, Cassandra & MongoDB☆22Updated 8 years ago
- A small project to show how to add lineage to Atlas when using Spark as ETL tool☆12Updated 8 years ago
- Build configuration-driven ETL pipelines on Apache Spark☆159Updated 2 years ago