Docker multi-nodes Hadoop cluster with Spark 2.4.1 on Yarn
☆50Dec 7, 2020Updated 5 years ago
Alternatives and similar repositories for docker-spark-yarn-cluster
Users that are interested in docker-spark-yarn-cluster are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Apache Spark on Apache Yarn 2.6.0 cluster Docker image☆11Oct 18, 2017Updated 8 years ago
- Lets Airflow DAGs run Spark jobs via Livy: sessions and/or batches.☆18May 23, 2023Updated 3 years ago
- Base Docker image with just essentials: Hadoop, Hive and Spark.☆67Feb 3, 2021Updated 5 years ago
- A ready to go Big Data cluster (Hadoop + Hadoop Streaming + Spark + PySpark) with Docker and Docker Swarm!☆22May 20, 2025Updated last year
- Repository containing Docker images for Spark master and slave☆15Nov 3, 2019Updated 6 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- MySQL Binlog based Changed Data Capture☆11Apr 26, 2017Updated 9 years ago
- Experiments, results and additional material from "Mastering Java Machine Learning" (PACKT Publishing)☆14Jul 10, 2017Updated 9 years ago
- Machine Learning with Scala Quick Start Guide, published by Packt☆24Jul 20, 2023Updated 3 years ago
- Hadoop, Hive, Spark, Zeppelin and Livy: all in one Docker-compose file.☆168Feb 4, 2021Updated 5 years ago
- A dockerized small bigdata cluster to play with☆12Jun 14, 2016Updated 10 years ago
- Spark Streaming example project which pulls messages from Kafka and write to HBase Table.☆11Jul 5, 2015Updated 11 years ago
- Apache Spark enhanced with Volcano, a Kubernetes native batch system☆11Oct 13, 2022Updated 3 years ago
- A Spark cluster setup running on Docker containers☆61Dec 26, 2019Updated 6 years ago
- Apache Spark docker image☆2,049Apr 20, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A collection of “cookbook-style” scripts for simplifying data engineering and machine learning in Apache Spark.☆13Oct 27, 2021Updated 4 years ago
- A Hadoop cluster based on Docker, including Hive and Spark.☆83Nov 13, 2022Updated 3 years ago
- Spark and Hive docker containers sharing a common MySQL metastore☆26Apr 17, 2020Updated 6 years ago
- Docker image for Apache Hive running on Tez☆25Apr 24, 2015Updated 11 years ago
- k8s hadoop,在k8s上快速搭建一个hadoop/hbase/hive环境，很早的项目自已用，腾讯tbds培训，以此为基础(多了一个kafka/flink)搭一套环境练习，又捡起来了☆21Mar 21, 2021Updated 5 years ago
- Spark 3.0.0 Structured Streaming Kafka Avro Demo☆15Apr 21, 2023Updated 3 years ago
- Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from…☆35Jan 5, 2023Updated 3 years ago
- "The history of astronomy is a history of receding horizons."― Edwin Powell Hubble☆13Jan 20, 2021Updated 5 years ago
- This construct builds some elements for you to quickly launch an EMR Serverless application. After submitting the Emr Serverless job, you…☆11Nov 18, 2025Updated 10 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆21Jun 13, 2023Updated 3 years ago
- ♟Play chess against real players in your terminal using Lichess☆10May 27, 2020Updated 6 years ago
- Postgresql configured to work as metastore for Hive.☆33Dec 16, 2022Updated 3 years ago
- 以慕课网日志分析为例 进入大数据 Spark SQL 的世界☆15Apr 3, 2018Updated 8 years ago
- Docker-compose contains the most common big data systems like: Apache Hadoop, Apache Hive, Apache Spark, Jupyter, Flink☆28Oct 9, 2023Updated 2 years ago
- Pandas Helper Library for reading and writing DataFrames from and to HBase.☆10Mar 8, 2018Updated 8 years ago
- 源码主要用于学习：1. Spring Boot+Hadoop+Hive+Hbase实现数据基本操作,Hive数据源使用Alibaba DruidDataSource，以及JDBCTemplate操作数据, Hbase使用hbase-client实现数据操作, API可视化界…☆21Jul 27, 2021Updated 5 years ago
- 🔧 Useless but cool.☆14Mar 13, 2025Updated last year
- An example project that implements a data pipeline using Scala, Akka, and Spark and works with document-oriented and graph databases to l…☆11Aug 9, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Hands-On Scala Programming [Video], published by Packt☆13Oct 31, 2022Updated 3 years ago
- A sample project shows how to run Spark Streaming app with Kafka in Docker☆35Oct 25, 2017Updated 8 years ago
- An application to interact with your FHIR API's using natural language query☆16Jul 6, 2023Updated 3 years ago
- Simulator for HDD/SSD, derived from the CMU PDL DiskSim, with the SSD-add-on patch from Microsoft Research applied.☆15Dec 30, 2019Updated 6 years ago
- Manage RabbitMQ with Ansible☆34Jun 22, 2026Updated 3 months ago
- Airflow DAGs and Scripts for Pushing Daily CSV dumps into Singer☆23May 8, 2017Updated 9 years ago
- ☆15Dec 19, 2025Updated 9 months ago