rogaha / data-processing-pipelineLinks
Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra
☆85Updated 8 years ago
Alternatives and similar repositories for data-processing-pipeline
Users that are interested in data-processing-pipeline are comparing it to the libraries listed below
Sorting:
- Docker container for Kafka - Spark Streaming - Cassandra☆98Updated 6 years ago
- Real-world Spark pipelines examples☆83Updated 7 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆174Updated 2 months ago
- A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python,…☆209Updated 6 years ago
- An example Apache Beam project.☆111Updated 8 years ago
- Some class materials for a data processing course using PySpark☆52Updated 2 years ago
- Examples To Help You Learn Apache Spark☆77Updated 6 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- Docker Image and Kubernetes Configurations for Spark 2.x☆41Updated 5 years ago
- A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.☆96Updated 4 years ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- Gallery of Apache Zeppelin notebooks☆216Updated 6 years ago
- ☆24Updated 9 years ago
- Materials (slides and code) for Kafka and Kafka Streams Workshops☆62Updated last year
- Ansible playbooks for Apache Spark on kube☆27Updated 8 years ago
- HDF masterclass materials☆28Updated 9 years ago
- These are some code examples☆55Updated 5 years ago
- Big Data Modeling, MapReduce, Spark, PySpark @ Santa Clara University☆158Updated 8 months ago
- ☆247Updated 5 years ago
- Repository used for Spark Trainings☆54Updated 2 years ago
- A curated list of awesome Apache Spark packages and resources.☆40Updated 8 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 6 years ago
- Apache Spark™ and Scala Workshops☆263Updated last year
- Spark on Kubernetes using Helm☆34Updated 5 years ago
- The purpose of this tiny project is to put things together with the know how that i learned from the course big data expert from formacio…☆62Updated 6 years ago
- Lightweight proxy to expose the UI of an Apache Spark cluster that is behind a firewall☆98Updated 5 years ago
- ☆14Updated 8 years ago
- ☆81Updated last year
- Analyze and visualize Twitter Sentiment on a world map using Spark MLlib☆140Updated 4 years ago
- Mastering Spark for Data Science, published by Packt☆47Updated 2 years ago