rogaha / data-processing-pipeline
Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra
☆86Updated 7 years ago
Related projects: ⓘ
- Docker container for Kafka - Spark Streaming - Cassandra☆98Updated 5 years ago
- Real-world Spark pipelines examples☆83Updated 6 years ago
- Some class materials for a data processing course using PySpark☆51Updated last year
- A curated list of awesome Apache Spark packages and resources.☆40Updated 7 years ago
- This project describes how to write full ETL data pipeline using spark.☆15Updated last year
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆171Updated 10 months ago
- Ansible playbooks for Apache Spark on kube☆27Updated 7 years ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- Code for Tutorial on designing clickstream analytics application using Hadoop☆54Updated 9 years ago
- Docker Image and Kubernetes Configurations for Spark 2.x☆40Updated 4 years ago
- An example Apache Beam project.☆111Updated 7 years ago
- Spark package for checking data quality☆25Updated last year
- How to build an awesome data engineering team☆99Updated 5 years ago
- ☆74Updated 4 years ago
- Code examples and docker environment for Spark☆26Updated 8 years ago
- real time log event processing using spark, kafka & cassandra☆13Updated 9 years ago
- Big Data ETL and Utilities for Hadoop Map Reduce, Spark and Storm☆105Updated 7 months ago
- ☆24Updated 8 years ago
- Some notebook examples related to Apache Spark, IPython / Jupyter, Zeppelin☆52Updated 8 years ago
- ☆9Updated 8 years ago
- ☆19Updated this week
- Examples To Help You Learn Apache Spark☆78Updated 5 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆75Updated 5 years ago
- A place in which we publish scripts for reproducible benchmarks.☆107Updated 4 years ago
- A stack overflow for Apache Spark☆72Updated 7 years ago
- Structured Streaming Machine Learning example with Spark 2.0☆92Updated 7 years ago
- Sentiment Analysis of a Twitter Topic with Spark Structured Streaming☆54Updated 5 years ago
- Collection of Pig scripts that I use for my talks and workshops☆40Updated 11 years ago
- These are some code examples☆55Updated 4 years ago
- PySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2☆81Updated 4 years ago