jware-solutions / docker-big-data-cluster
A ready to go Big Data cluster (Hadoop + Hadoop Streaming + Spark + PySpark) with Docker and Docker Swarm!
☆19Updated last month
Alternatives and similar repositories for docker-big-data-cluster:
Users that are interested in docker-big-data-cluster are comparing it to the libraries listed below
- Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…☆118Updated 3 weeks ago
- Base Docker image with just essentials: Hadoop, Hive and Spark.☆68Updated 4 years ago
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 2 years ago
- ☆28Updated last year
- spark on kubernetes☆105Updated 2 years ago
- Example to create lineage in Atlas with sqoop and spark☆14Updated 7 years ago
- Hadoop, Hive, Spark, Zeppelin and Livy: all in one Docker-compose file.☆162Updated 4 years ago
- Docker multi-nodes Hadoop cluster with Spark 2.4.1 on Yarn☆51Updated 4 years ago
- Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines☆128Updated 2 years ago
- A simple Spark-powered ETL framework that just works 🍺☆179Updated 2 weeks ago
- Infrastructure automation to deploy Hadoop,Hive,Spark,airflow nodes on a docker host☆20Updated 6 years ago
- Smart Automation Tool for building modern Data Lakes and Data Pipelines☆118Updated last week
- Examples of Spark 3.0☆47Updated 4 years ago
- Zeppelin docker☆15Updated 4 years ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆43Updated last year
- The source code for the book Modern Data Engineering with Apache Spark☆35Updated 2 years ago
- Apache Spark 3 - Structured Streaming Course Material☆44Updated 4 years ago
- Spline agent for Apache Spark☆191Updated 2 weeks ago
- A Spark datasource for the HadoopOffice library☆38Updated 2 years ago
- Multi-stage, config driven, SQL based ETL framework using PySpark☆25Updated 5 years ago
- A general purpose framework for automating Cloudera Products☆66Updated 3 months ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- ☆27Updated last month
- One Click Script to Deploy CDP (CDP PvC & HDP & CDH)☆30Updated this week
- Spark-Radiant is Apache Spark Performance and Cost Optimizer☆25Updated last month
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆94Updated last week
- REST API for Apache Spark on K8S or YARN☆95Updated this week
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆72Updated 3 years ago
- This repo is a collection of tools to deploy, manage and operate a Databricks based Lakehouse.☆44Updated 3 weeks ago
- Nested Data (JSON/AVRO/XML) Parsing and Flattening in Spark☆16Updated last year