The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Postgres, Cassandra, Hue, Zeppelin, Kadmin, Kafka Control Center and pgAdmin. This cluster is solely intended for usage in a development environment. Do not use it to run any production workloads.
☆82Feb 27, 2023Updated 3 years ago
Alternatives and similar repositories for Big-Data-Cluster
Users that are interested in Big-Data-Cluster are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Hadoop-Hive-Spark cluster + Jupyter on Docker☆84Jan 2, 2025Updated last year
- Repository for building docker image, with open-source applications☆26Apr 23, 2024Updated 2 years ago
- Run Hadoop Cluster within Docker Containers.☆17Mar 6, 2025Updated last year
- Demonstrating practical SQL skills through a curated portfolio of solved problems from top coding platforms.☆51Sep 11, 2026Updated last month
- Blog API with Django Rest Framework.☆13Jan 4, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆15May 1, 2024Updated 2 years ago
- Airflow Examples: code samples for Medium articles☆14Jan 10, 2021Updated 5 years ago
- A lightweight, open-source UI for dbt that provides model browsing, lineage visualization, run orchestration, documentation previews, and…☆72Oct 11, 2026Updated last week
- This is the dining reservation system using Google Apps Script.☆15Jan 22, 2024Updated 2 years ago
- Base hadoop/spark/bigdata image with advanced config loading scripts.☆11Nov 3, 2020Updated 5 years ago
- Repositorio utilizado para el Curso de Hadoop en Platzi☆11Dec 9, 2020Updated 5 years ago
- A shell script to automate the operations of sqoop☆11Mar 29, 2021Updated 5 years ago
- OPC UA simulation server written in Python, which sends out 3 values from a real data set☆73Jan 24, 2023Updated 3 years ago
- ☆12May 27, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Binary Particle Swarm Optimization applied to the unit commitment problem in an electric microgrid.☆15Jun 22, 2019Updated 7 years ago
- ☆20Mar 11, 2025Updated last year
- Extract, transform, and load data for analytic processing using AWS Glue☆17May 2, 2021Updated 5 years ago
- Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand☆56Sep 30, 2023Updated 3 years ago
- R code to perform the Lee Strazicich unit root test☆10Aug 8, 2017Updated 9 years ago
- R package for Markov regime-switching models☆12Jan 23, 2018Updated 8 years ago
- ☆28Dec 31, 2024Updated last year
- A Python PySpark Projet with Poetry☆31May 2, 2026Updated 5 months ago
- ☆11Sep 28, 2022Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Tutorial for running Django on Azure☆16Feb 7, 2026Updated 8 months ago
- Public Docker Images for popular services☆57Sep 13, 2026Updated last month
- Data pipeline for extracting, transforming, and visualising Covid-19 data☆14Apr 23, 2023Updated 3 years ago
- A minimal docker compose setup for experimenting with cloud agnostic Lakehouse Architectures Apache Spark with Hive Metastore + Delta Lak…☆34Apr 17, 2024Updated 2 years ago
- Project - Data Processing and Analysis in Python Course☆39Oct 10, 2018Updated 8 years ago
- ☆10Jul 24, 2024Updated 2 years ago
- audio, NLP, ML with huggingface, nvidia/nemo, speechbrain☆11Sep 4, 2023Updated 3 years ago
- Small data engineering tutorial☆10Oct 24, 2018Updated 7 years ago
- Dockerizing an Apache Spark Standalone Cluster☆42Jun 29, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Big Data Inventory Management on AWS (Demand Forecasting, Machine Learning, Dashboarding) : Presented at Carlson School of Management dur…☆11Apr 15, 2020Updated 6 years ago
- Todo App with nodeJs, Express, Mongoose and MongoDB☆20Updated this week
- ☆14Oct 25, 2020Updated 5 years ago
- This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenA…☆47Jan 4, 2024Updated 2 years ago
- A flake8 plugin that detects of usage withColumn in a loop or inside reduce☆29Jun 20, 2025Updated last year
- Big Data Ecosystem Docker☆431Apr 29, 2023Updated 3 years ago
- This repository contains an end-to-end data engineering project using Apache Flink, focused on performing sales analytics. The project de…☆12Nov 18, 2023Updated 2 years ago