rogaha / data-processing-pipeline
Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra
☆84Updated 7 years ago
Alternatives and similar repositories for data-processing-pipeline:
Users that are interested in data-processing-pipeline are comparing it to the libraries listed below
- Docker container for Kafka - Spark Streaming - Cassandra☆97Updated 5 years ago
- This project describes how to write full ETL data pipeline using spark.☆15Updated 2 years ago
- Real-world Spark pipelines examples☆83Updated 6 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆62Updated 5 years ago
- ☆49Updated 5 years ago
- ☆75Updated 4 years ago
- Examples To Help You Learn Apache Spark☆77Updated 6 years ago
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆183Updated 2 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- How to build an awesome data engineering team☆99Updated 5 years ago
- Repository used for Spark Trainings☆53Updated last year
- Code examples and docker environment for Spark☆27Updated 8 years ago
- Real-time Machine Learning with Apache Spark on Twitter Public Stream☆68Updated 7 years ago
- These are some code examples☆55Updated 5 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆174Updated last year
- A curated list of awesome Apache Spark packages and resources.☆40Updated 7 years ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- Demos around Ambari Views, Services, Blueprints☆63Updated 8 years ago
- Big Data ETL and Utilities for Hadoop Map Reduce, Spark and Storm☆103Updated last year
- A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python,…☆208Updated 6 years ago
- ☆24Updated 8 years ago
- ☆53Updated 2 years ago
- A stack overflow for Apache Spark☆72Updated 7 years ago
- ☆37Updated 8 years ago
- ☆28Updated 4 years ago
- Code for Tutorial on designing clickstream analytics application using Hadoop☆54Updated 9 years ago
- Some class materials for a data processing course using PySpark☆52Updated 2 years ago
- Apache Spark and Apache Kafka integration example☆124Updated 7 years ago
- Apache-kafka-spark-streaming-poc☆10Updated 7 years ago
- Mastering Spark for Data Science, published by Packt☆47Updated 2 years ago