Hadoop, Hive, Spark, Zeppelin and Livy: all in one Docker-compose file.
☆168Feb 4, 2021Updated 5 years ago
Alternatives and similar repositories for bigdata-docker-compose
Users that are interested in bigdata-docker-compose are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Base Docker image with just essentials: Hadoop, Hive and Spark.☆67Feb 3, 2021Updated 5 years ago
- Deploy bigdata platform using docker compose. Big data components include hadoop, hive, hbase, presto, flink, es, kafka, etc.☆150Sep 23, 2024Updated last year
- Lets Airflow DAGs run Spark jobs via Livy: sessions and/or batches.☆18May 23, 2023Updated 3 years ago
- Hadoop-Hive-Spark cluster + Jupyter on Docker☆84Jan 2, 2025Updated last year
- Docker with hadoop spark pig hive☆27Jul 22, 2019Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Big Data Ecosystem Docker☆431Apr 29, 2023Updated 3 years ago
- Spark Standalone & Livy☆11Jul 13, 2021Updated 5 years ago
- Zeppelin docker☆16Nov 16, 2020Updated 5 years ago
- Docker multi-nodes Hadoop cluster with Spark 2.4.1 on Yarn☆50Dec 7, 2020Updated 5 years ago
- A Hadoop cluster based on Docker, including Hive and Spark.☆83Nov 13, 2022Updated 3 years ago
- Docker Big Data Tools: This docker-compose file is configured to run multiple nodes. This is a Hadoop Cluster that contains the necessary…☆31Jul 6, 2021Updated 5 years ago
- ☆144Apr 21, 2022Updated 4 years ago
- docker-hadoop-spark-hive 快速构建你的大数据环境☆21Jan 4, 2020Updated 6 years ago
- A ready to go Big Data cluster (Hadoop + Hadoop Streaming + Spark + PySpark) with Docker and Docker Swarm!☆22May 20, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [EXPERIMENTAL] This repo includes deployment instructions for running HDFS/Spark inside docker containers. Also includes spark-notebook a…☆702Oct 1, 2020Updated 5 years ago
- Docker images for building hadoop3.2, hive 3.1, hbase2.3, presto 0.247, flink1.11.3 on yarn, etc.☆32Apr 25, 2023Updated 3 years ago
- Multi-container environment with Hadoop, Spark and Hive☆234May 5, 2025Updated last year
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆120Jul 20, 2021Updated 5 years ago
- The demo of using Kafka, Spark, Hive, Cassandra, etc by using Docker. It produces the production ready environment for any kinds of big d…☆37Sep 27, 2019Updated 6 years ago
- docker构建大数据开发学习环境☆52Nov 7, 2016Updated 9 years ago
- Docker image for Apache Hive Metastore☆71Apr 18, 2023Updated 3 years ago
- ☆12Feb 11, 2022Updated 4 years ago
- Big Data infrastructure with Hadoop, Spark, Hive and NiFi deployed using Docker Compose. https://doi.org/10.5281/zenodo.18968438☆28Aug 26, 2026Updated last week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Simple functional examples of running Hadoop + Hive in Docker with Docker Compose☆24Dec 25, 2022Updated 3 years ago
- Find Datasets Observing Specific Conditions☆14Nov 5, 2020Updated 5 years ago
- Apache Hadoop docker image☆2,325Feb 1, 2024Updated 2 years ago
- Spark and Hive docker containers sharing a common MySQL metastore☆26Apr 17, 2020Updated 6 years ago
- Apache Spark docker image☆2,051Apr 20, 2026Updated 4 months ago
- A simple spark standalone cluster for your testing environment purposses☆568Mar 6, 2024Updated 2 years ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆100Jan 31, 2023Updated 3 years ago
- A docker using the airflow with Hadoop ecosystem (hive, spark, and sqoop)☆12May 2, 2021Updated 5 years ago
- Rbusiness☆14Jun 16, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆24Aug 9, 2023Updated 3 years ago
- Hadoop, Hive and PrestoDB for deployment using Docker☆26Oct 21, 2025Updated 10 months ago
- A containerized approach using Apache Kafka, Spark, Cassandra, Hive, Jupyter, and Docker-compose.☆14Apr 14, 2021Updated 5 years ago
- Apache Flink docker image☆196Jul 1, 2022Updated 4 years ago
- Usage examples for the JOPA framework.☆11Updated this week
- Demo for service oriented application hosted on Hadoop YARN cluster for HA and scheduling☆23Apr 2, 2018Updated 8 years ago
- ☆1,081Jun 2, 2024Updated 2 years ago