jware-solutions / docker-big-data-cluster
A ready to go Big Data cluster (Hadoop + Hadoop Streaming + Spark + PySpark) with Docker and Docker Swarm!
☆19Updated 2 months ago
Alternatives and similar repositories for docker-big-data-cluster:
Users that are interested in docker-big-data-cluster are comparing it to the libraries listed below
- Base Docker image with just essentials: Hadoop, Hive and Spark.☆68Updated 4 years ago
- Hadoop, Hive, Spark, Zeppelin and Livy: all in one Docker-compose file.☆163Updated 4 years ago
- Smart Automation Tool for building modern Data Lakes and Data Pipelines☆120Updated last week
- Edge2AI Workshop☆69Updated 2 months ago
- Docker multi-nodes Hadoop cluster with Spark 2.4.1 on Yarn☆51Updated 4 years ago
- Multi-container environment with Hadoop, Spark and Hive☆210Updated last year
- A simple Spark-powered ETL framework that just works 🍺☆181Updated this week
- spark on kubernetes☆105Updated 2 years ago
- CSD for Apache Airflow☆20Updated 5 years ago
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 2 years ago
- Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines☆130Updated 2 years ago
- Example to create lineage in Atlas with sqoop and spark☆14Updated 7 years ago
- Quick Guides from Dremio on Several topics☆69Updated 2 months ago
- ☆28Updated last year
- Multi-stage, config driven, SQL based ETL framework using PySpark☆25Updated 5 years ago
- Examples of Spark 3.0☆47Updated 4 years ago
- Apache Spark 3 - Structured Streaming Course Material☆121Updated last year
- A general purpose framework for automating Cloudera Products☆66Updated 3 weeks ago
- Zeppelin docker☆15Updated 4 years ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆45Updated last year
- ☆32Updated 7 years ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- Cloud-native Trino (prestosql) + Hive + Minio + Superset☆22Updated 3 years ago
- ☆92Updated 2 years ago
- Delta-Lake, ETL, Spark, Airflow☆46Updated 2 years ago
- "hms-mirror" is a utility used to bridge the gap between two clusters and migrate hive metadata.☆16Updated this week
- Extensible streaming ingestion pipeline on top of Apache Spark☆44Updated last year
- Spark Examples☆125Updated 3 years ago
- ☆22Updated 2 years ago
- Infrastructure automation to deploy Hadoop,Hive,Spark,airflow nodes on a docker host☆20Updated 6 years ago