rogaha / data-processing-pipelineLinks
Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra
☆85Updated 8 years ago
Alternatives and similar repositories for data-processing-pipeline
Users that are interested in data-processing-pipeline are comparing it to the libraries listed below
Sorting:
- Docker container for Kafka - Spark Streaming - Cassandra☆98Updated 5 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆174Updated last week
- Real-world Spark pipelines examples☆83Updated 7 years ago
- A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.☆96Updated 4 years ago
- HDF masterclass materials☆28Updated 9 years ago
- ☆24Updated 9 years ago
- A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python,…☆209Updated 6 years ago
- Code for Tutorial on designing clickstream analytics application using Hadoop☆54Updated 10 years ago
- ☆81Updated last year
- ☆75Updated 4 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆62Updated 5 years ago
- Some class materials for a data processing course using PySpark☆52Updated 2 years ago
- This project describes how to write full ETL data pipeline using spark.☆15Updated 2 years ago
- Spark on Kubernetes using Helm☆34Updated 4 years ago
- Docker Image and Kubernetes Configurations for Spark 2.x☆41Updated 5 years ago
- real time log event processing using spark, kafka & cassandra☆13Updated 10 years ago
- ☆28Updated 4 years ago
- How to build an awesome data engineering team☆100Updated 5 years ago
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- Ansible playbooks for Apache Spark on kube☆27Updated 7 years ago
- Spark Streaming HBase Example☆22Updated 9 years ago
- An example Apache Beam project.☆111Updated 8 years ago
- A stack overflow for Apache Spark☆72Updated 8 years ago
- Apache Spark and Apache Kafka integration example☆124Updated 7 years ago
- Structured Streaming Machine Learning example with Spark 2.0☆92Updated 8 years ago
- Examples for High Performance Spark☆15Updated 7 months ago
- Twitter Sentiment Analysis using Spark and Kafka☆115Updated 6 years ago
- Minikube for big data with Scala and Spark☆15Updated 5 years ago
- ☆49Updated 5 years ago