Marcel-Jan / docker-hadoop-spark
Multi-container environment with Hadoop, Spark and Hive
☆203Updated 10 months ago
Related projects ⓘ
Alternatives and complementary repositories for docker-hadoop-spark
- Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker.☆462Updated last year
- Hadoop-Hive-Spark cluster + Jupyter on Docker☆61Updated 5 months ago
- Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines☆123Updated 2 years ago
- A simple spark standalone cluster for your testing environment purposses☆557Updated 8 months ago
- A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.☆39Updated 3 years ago
- Docker with Airflow and Spark standalone cluster☆245Updated last year
- Hadoop, Hive, Spark, Zeppelin and Livy: all in one Docker-compose file.☆161Updated 3 years ago
- ☆252Updated 3 weeks ago
- A simplified, lightweight ETL Framework based on Apache Spark☆584Updated 9 months ago
- This project provides Apache Spark SQL, RDD, DataFrame and Dataset examples in Scala language☆559Updated 8 months ago
- The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Pos…☆55Updated last year
- Base Docker image with just essentials: Hadoop, Hive and Spark.☆67Updated 3 years ago
- Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…☆111Updated this week
- O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian☆209Updated last year
- Delta-Lake, ETL, Spark, Airflow☆44Updated 2 years ago
- ☆90Updated 2 years ago
- Apache Spark docker image☆2,041Updated last year
- Spark Examples☆124Updated 2 years ago
- A Spark plugin for reading and writing Excel files☆468Updated 2 weeks ago
- The Internals of Spark SQL☆456Updated this week
- Spark style guide☆256Updated last month
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆184Updated 11 months ago
- A simple Spark-powered ETL framework that just works 🍺☆178Updated 11 months ago
- ☆24Updated 2 months ago
- ☆23Updated 3 years ago
- Delta Lake examples☆207Updated last month
- Docker multi-nodes Hadoop cluster with Spark 2.4.1 on Yarn☆50Updated 3 years ago
- ☆22Updated 8 months ago