Marcel-Jan / docker-hadoop-spark
Multi-container environment with Hadoop, Spark and Hive
☆201Updated 10 months ago
Related projects ⓘ
Alternatives and complementary repositories for docker-hadoop-spark
- Hadoop, Hive, Spark, Zeppelin and Livy: all in one Docker-compose file.☆161Updated 3 years ago
- Docker with Airflow and Spark standalone cluster☆242Updated last year
- Hadoop-Hive-Spark cluster + Jupyter on Docker☆61Updated 5 months ago
- A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.☆39Updated 3 years ago
- Base Docker image with just essentials: Hadoop, Hive and Spark.☆67Updated 3 years ago
- Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker.☆453Updated last year
- Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines☆123Updated 2 years ago
- Docker multi-nodes Hadoop cluster with Spark 2.4.1 on Yarn☆50Updated 3 years ago
- A simplified, lightweight ETL Framework based on Apache Spark☆584Updated 9 months ago
- ☆252Updated 2 weeks ago
- The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Pos…☆53Updated last year
- Official Dockerfile for Apache Spark☆106Updated last week
- A simple spark standalone cluster for your testing environment purposses☆556Updated 8 months ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆96Updated last year
- Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…☆111Updated 2 months ago
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 2 years ago
- This project provides Apache Spark SQL, RDD, DataFrame and Dataset examples in Scala language☆558Updated 7 months ago
- Spark Standalone & Livy☆12Updated 3 years ago
- Delta-Lake, ETL, Spark, Airflow☆44Updated 2 years ago
- A Spark plugin for reading and writing Excel files☆467Updated last week
- ☆90Updated 2 years ago
- This is a GitHub for all of my NiFi Templates☆43Updated 4 years ago
- Spark on Kubernetes infrastructure Helm charts repo☆199Updated 2 years ago
- The Internals of Spark SQL☆454Updated 2 months ago
- The Internals of Delta Lake☆182Updated last month
- A simple Spark-powered ETL framework that just works 🍺☆178Updated 11 months ago
- A docker using the airflow with Hadoop ecosystem (hive, spark, and sqoop)☆11Updated 3 years ago
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆119Updated 3 years ago