The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Postgres, Cassandra, Hue, Zeppelin, Kadmin, Kafka Control Center and pgAdmin. This cluster is solely intended for usage in a development environment. Do not use it to run any production workloads.
☆79Feb 27, 2023Updated 3 years ago
Alternatives and similar repositories for Big-Data-Cluster
Users that are interested in Big-Data-Cluster are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Hadoop-Hive-Spark cluster + Jupyter on Docker☆86Jan 2, 2025Updated last year
- Demonstrating practical SQL skills through a curated portfolio of solved problems from top coding platforms.☆52Mar 18, 2026Updated 3 weeks ago
- Run Hadoop Cluster within Docker Containers.☆16Mar 6, 2025Updated last year
- This project demonstrates real-time data streaming and processing architecture using Kafka, Spark Streaming, and Debezium for capturing C…☆13Oct 24, 2024Updated last year
- Spark all the ETL Pipelines☆37Aug 2, 2023Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- This project aims to move the data from a Relational database system (RDBMS) to a Hadoop file system (HDFS)☆11Apr 29, 2022Updated 3 years ago
- ☆148Dec 27, 2024Updated last year
- ☆22Feb 5, 2024Updated 2 years ago
- Docker Big Data Tools: This docker-compose file is configured to run multiple nodes. This is a Hadoop Cluster that contains the necessary…☆31Jul 6, 2021Updated 4 years ago
- Base hadoop/spark/bigdata image with advanced config loading scripts.☆11Nov 3, 2020Updated 5 years ago
- ☆17Jul 10, 2022Updated 3 years ago
- Delta-Lake, ETL, Spark, Airflow☆49Oct 9, 2022Updated 3 years ago
- This repo is for generating data from existing dataset to a file or producing dataset rows as message to kafka in a streaming manner.☆22Jun 13, 2024Updated last year
- Public Docker Images for popular services☆51Sep 7, 2025Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Big Data Ecosystem Docker☆429Apr 29, 2023Updated 2 years ago
- Final Year Project: EPOS web application implementing an electronic point of sale interface, sales analytics, sales weekly/monthly/yearl…☆16Dec 9, 2021Updated 4 years ago
- Curso de Swarm☆12Nov 16, 2018Updated 7 years ago
- This Repo contains Jupyter Notebooks to recap on RDD, DataFrame, Spark Streaming and ML operations using Pyspark☆11Nov 3, 2024Updated last year
- Airflow Examples: code samples for Medium articles☆14Jan 10, 2021Updated 5 years ago
- An end-to-end, containerized data pipeline for near-real-time user event analytics using Kafka, ClickHouse, Airflow, and PySpark. Made to…☆73Sep 12, 2025Updated 7 months ago
- Data engineering mentorship program☆187Feb 21, 2026Updated last month
- Extract, transform, and load data for analytic processing using AWS Glue☆17May 2, 2021Updated 4 years ago
- TrafficAdvisor: a Real-Time Traffic Monitoring System☆14Sep 10, 2018Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆21Mar 11, 2025Updated last year
- Dockerizing an Apache Spark Standalone Cluster☆42Jun 29, 2022Updated 3 years ago
- ☆11Sep 28, 2022Updated 3 years ago
- Not everyone can code, but everyone can learn. This Project is an AI powered DSA/Competitive Programming Helper with an inbuilt editor to…☆14Jun 3, 2025Updated 10 months ago
- On-premises ELT Pipeline☆31Jul 10, 2025Updated 9 months ago
- ☆16Apr 1, 2024Updated 2 years ago
- Structured workflows for AI agents. Guides Claude Code, Cursor, Codex, and other AI assistants through deliberate software development wi…☆27Oct 8, 2025Updated 6 months ago
- ☆12Jul 27, 2021Updated 4 years ago
- Spark implementation of Slowly Changing Dimension type 2☆11Jan 8, 2019Updated 7 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The repository for my talk titled the same☆15Nov 20, 2019Updated 6 years ago
- Source code for paper "Breaking Security-Critical Voice Authentication".☆13Jul 10, 2023Updated 2 years ago
- Tutorial and examples for using Apache Spark☆18Jul 21, 2017Updated 8 years ago
- Docker powered container for using Nginx as reverse-proxy in combination with an OpenVPN Client.☆11Jan 1, 2020Updated 6 years ago
- Now updated prior to the version on CRAN.☆14Jan 9, 2024Updated 2 years ago
- La regresión linear es un algoritmo clásico de machine learning que es muy fácil de implementar. Sin embargo, es muy poderoso y tiene muc…☆14Jan 24, 2021Updated 5 years ago
- R package for Markov regime-switching models☆12Jan 23, 2018Updated 8 years ago