jware-solutions / docker-big-data-clusterLinks
A ready to go Big Data cluster (Hadoop + Hadoop Streaming + Spark + PySpark) with Docker and Docker Swarm!
☆20Updated last month
Alternatives and similar repositories for docker-big-data-cluster
Users that are interested in docker-big-data-cluster are comparing it to the libraries listed below
Sorting:
- Docker multi-nodes Hadoop cluster with Spark 2.4.1 on Yarn☆51Updated 4 years ago
- Base Docker image with just essentials: Hadoop, Hive and Spark.☆70Updated 4 years ago
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 2 years ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- Spark on Kubernetes infrastructure Helm charts repo☆203Updated 2 years ago
- A general purpose framework for automating Cloudera Products☆67Updated 3 months ago
- A simple Spark-powered ETL framework that just works 🍺☆181Updated last month
- spark on kubernetes☆104Updated 2 years ago
- Edge2AI Workshop☆70Updated 2 weeks ago
- The Internals of Spark on Kubernetes☆71Updated 3 years ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆99Updated 2 years ago
- ☆27Updated last year
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆95Updated last week
- Smart Automation Tool for building modern Data Lakes and Data Pipelines☆124Updated this week
- Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…☆125Updated last month
- REST API for Apache Spark on K8S or YARN☆98Updated 3 weeks ago
- DataQuality for BigData☆144Updated last year
- Hadoop, Hive, Spark, Zeppelin and Livy: all in one Docker-compose file.☆166Updated 4 years ago
- Zeppelin docker☆15Updated 4 years ago
- Infrastructure automation to deploy Hadoop,Hive,Spark,airflow nodes on a docker host☆20Updated 6 years ago
- "hms-mirror" is a utility used to bridge the gap between two clusters and migrate hive metadata.☆17Updated last month
- Examples of Spark 3.0☆47Updated 4 years ago
- Spline agent for Apache Spark☆194Updated this week
- One Click Script to Deploy CDP (CDP PvC & HDP & CDH)☆31Updated last month
- A generic ETL framework with Spark_SQL for transforming data by constructing pipelines with Yaml/Json/Xml☆15Updated 5 months ago
- The demo of using Kafka, Spark, Hive, Cassandra, etc by using Docker. It produces the production ready environment for any kinds of big d…☆34Updated 5 years ago
- Ambari stack service for installing and managing Apache Airflow on HDP cluster☆59Updated 6 years ago
- ☆265Updated 8 months ago
- An ETL framework in Scala for Data Engineers☆22Updated 2 years ago
- A library that provides useful extensions to Apache Spark and PySpark.☆226Updated 3 months ago