msemn / bd-infra
☆90Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for bd-infra
- Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines☆123Updated 2 years ago
- Base Docker image with just essentials: Hadoop, Hive and Spark.☆67Updated 3 years ago
- Multi-container environment with Hadoop, Spark and Hive☆203Updated 10 months ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆96Updated last year
- spark on kubernetes☆105Updated last year
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 2 years ago
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆119Updated 3 years ago
- A simple spark standalone cluster for your testing environment purposses☆559Updated 8 months ago
- A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.☆39Updated 3 years ago
- Delta-Lake, ETL, Spark, Airflow☆44Updated 2 years ago
- Apache Flink docker image☆194Updated 2 years ago
- Docker Big Data Tools: This docker-compose file is configured to run multiple nodes. This is a Hadoop Cluster that contains the necessary…☆28Updated 3 years ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆40Updated 11 months ago
- CSD for Apache Airflow☆20Updated 5 years ago
- Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker.☆463Updated last year
- Docker with Airflow and Spark standalone cluster☆246Updated last year
- Hadoop-Hive-Spark cluster + Jupyter on Docker☆61Updated 5 months ago
- This Apache Atlas is built from the latest release source tarball and patched to be run in a Docker container.☆140Updated 10 months ago
- Setting up a single node Cloudera Hadoop on cloud with quickstart image, docker and docker compose☆36Updated 2 years ago
- Spark on Kubernetes using Helm☆34Updated 4 years ago
- Edge2AI Workshop☆68Updated 3 weeks ago
- The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Pos…☆55Updated last year
- ☆26Updated 4 years ago
- A simplified, lightweight ETL Framework based on Apache Spark☆585Updated 10 months ago
- Zeppelin docker☆15Updated 4 years ago
- Youtube Apache NiFi 2022 Series resources☆72Updated last year
- Docker multi-nodes Hadoop cluster with Spark 2.4.1 on Yarn☆50Updated 3 years ago
- Hadoop, Hive, Spark, Zeppelin and Livy: all in one Docker-compose file.☆161Updated 3 years ago