EthicalML / kafka-spark-streaming-zeppelin-docker
One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)
☆120Updated 3 years ago
Related projects: ⓘ
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆91Updated this week
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆96Updated last year
- This repository contains code for Spark Streaming☆21Updated 3 years ago
- Spark on Kubernetes using Helm☆34Updated 4 years ago
- spark on kubernetes☆105Updated last year
- ☆235Updated this week
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 2 years ago
- Smart Automation Tool for building modern Data Lakes and Data Pipelines☆104Updated this week
- Ambari stack service for installing and managing Apache Airflow on HDP cluster☆59Updated 5 years ago
- Docker image for Jupyter notebooks with PySpark☆27Updated 6 years ago
- Apche Spark Structured Streaming with Kafka using Python(PySpark)☆41Updated 5 years ago
- The Internals of Delta Lake☆180Updated last month
- Code for docker images☆39Updated last year
- The Internals of Spark on Kubernetes☆71Updated 2 years ago
- Base Docker image with just essentials: Hadoop, Hive and Spark.☆67Updated 3 years ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆171Updated 10 months ago
- Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines☆121Updated last year
- Spark on Kubernetes infrastructure Helm charts repo☆199Updated last year
- A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.☆39Updated 3 years ago
- Real-world Spark pipelines examples☆83Updated 6 years ago
- Presto Trino with Apache Hive Postgres metastore☆36Updated last week
- A simple Spark-powered ETL framework that just works 🍺☆177Updated 9 months ago
- Spark Examples☆124Updated 2 years ago
- Demo of PySpark and Jupyter Notebook with the Jupyter Docker Stacks☆35Updated 3 years ago
- A simplified, lightweight ETL Framework based on Apache Spark☆581Updated 7 months ago
- CSD for Apache Airflow☆20Updated 5 years ago
- REST API for Apache Spark on K8S or YARN☆89Updated last week
- Repo for all my code on the articles I post on medium☆105Updated last year
- Multi-container environment with Hadoop, Spark and Hive☆195Updated 8 months ago