EthicalML / kafka-spark-streaming-zeppelin-docker
One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)
☆120Updated 3 years ago
Alternatives and similar repositories for kafka-spark-streaming-zeppelin-docker:
Users that are interested in kafka-spark-streaming-zeppelin-docker are comparing it to the libraries listed below
- Base Docker image with just essentials: Hadoop, Hive and Spark.☆69Updated 4 years ago
- spark on kubernetes☆105Updated 2 years ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆97Updated 2 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆174Updated last year
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 2 years ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆94Updated 2 weeks ago
- Spark Examples☆125Updated 3 years ago
- Spark on Kubernetes using Helm☆34Updated 4 years ago
- Hadoop, Hive, Spark, Zeppelin and Livy: all in one Docker-compose file.☆163Updated 4 years ago
- Code for docker images☆39Updated last year
- Smart Automation Tool for building modern Data Lakes and Data Pipelines☆120Updated this week
- Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines☆128Updated 2 years ago
- Spark on Kubernetes infrastructure Helm charts repo☆198Updated 2 years ago
- A simplified, lightweight ETL Framework based on Apache Spark☆584Updated last year
- Multi-container environment with Hadoop, Spark and Hive☆209Updated last year
- Real-world Spark pipelines examples☆83Updated 7 years ago
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆183Updated last year
- How to build an awesome data engineering team☆100Updated 5 years ago
- Apache Spark docker container image (Standalone mode)☆35Updated 4 years ago
- Examples of Spark 3.0☆47Updated 4 years ago
- A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.☆39Updated 3 years ago
- ☆26Updated 2 years ago
- The Internals of Delta Lake☆183Updated 2 months ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- A simple Spark-powered ETL framework that just works 🍺☆181Updated 3 weeks ago
- Apche Spark Structured Streaming with Kafka using Python(PySpark)☆41Updated 5 years ago
- The demo of using Kafka, Spark, Hive, Cassandra, etc by using Docker. It produces the production ready environment for any kinds of big d…☆32Updated 5 years ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆45Updated last year
- O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian☆213Updated last year
- Spark and Hive docker containers sharing a common MySQL metastore☆26Updated 4 years ago