The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Postgres, Cassandra, Hue, Zeppelin, Kadmin, Kafka Control Center and pgAdmin. This cluster is solely intended for usage in a development environment. Do not use it to run any production workloads.
☆82Feb 27, 2023Updated 3 years ago
Alternatives and similar repositories for Big-Data-Cluster
Users that are interested in Big-Data-Cluster are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Hadoop-Hive-Spark cluster + Jupyter on Docker☆84Jan 2, 2025Updated last year
- Run Hadoop Cluster within Docker Containers.☆17Mar 6, 2025Updated last year
- Docker Big Data Tools: This docker-compose file is configured to run multiple nodes. This is a Hadoop Cluster that contains the necessary…☆31Jul 6, 2021Updated 5 years ago
- ☆28Dec 31, 2024Updated last year
- Demonstrating practical SQL skills through a curated portfolio of solved problems from top coding platforms.☆52Sep 11, 2026Updated last month
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Data Analysis and BI Resources 📊☆42Dec 22, 2024Updated last year
- ITI Intensive Code Camp – (Power BI Developer) Specialization☆14Jul 6, 2025Updated last year
- ☆24Aug 8, 2021Updated 5 years ago
- A data pipeline for the ingestion & visualisation of U.S Geological Survey Earthquake data☆14Jun 24, 2024Updated 2 years ago
- Here I will be exploring various tools and methods that are used in data engineering process with Python.☆21Jan 4, 2021Updated 5 years ago
- قاعدة بيانات JSON تحتوي على أحداث تاريخية لها تعلق بالإسلام والمسلمين .☆11Sep 9, 2023Updated 3 years ago
- Delta-Lake, ETL, Spark, Airflow☆49Oct 9, 2022Updated 4 years ago
- ☆15May 1, 2024Updated 2 years ago
- Public workshop code for AI Shipping Labs☆15Updated this week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Airflow Examples: code samples for Medium articles☆14Jan 10, 2021Updated 5 years ago
- A lightweight frontend web application built with React.js for interacting with the Ollama API Localy.☆11Aug 11, 2025Updated last year
- A basic Text2SQL App, powered by Langchain and OpenAI.☆12Jun 27, 2024Updated 2 years ago
- Spark application to consume kafka events generated by a python producer.☆12Aug 7, 2021Updated 5 years ago
- ☆23Feb 5, 2024Updated 2 years ago
- Big Data Ecosystem Docker☆432Apr 29, 2023Updated 3 years ago
- Scalable OLAP system for credit card transaction analysis, leveraging AWS S3, Databricks, and dbt. Features end-to-end batch processing p…☆26Oct 24, 2024Updated 2 years ago
- BES (Bigdata Ecosystem Sandbox) is an all-in-one development and learning environment designed to simplify the exploration, experimentati…☆11Nov 18, 2024Updated last year
- This repo hosts several projects based on geospatial embeddings.☆11Dec 16, 2025Updated 10 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆12Jul 22, 2025Updated last year
- ☆20Mar 11, 2025Updated last year
- Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand☆56Sep 30, 2023Updated 3 years ago
- Extract, transform, and load data for analytic processing using AWS Glue☆17May 2, 2021Updated 5 years ago
- Apache Cassandra Health Check Tooling☆12Jun 11, 2026Updated 4 months ago
- Vagrant / Ansible environment to deploy a local TDP cluster☆20Jan 9, 2026Updated 9 months ago
- This repo gives an introduction to setting up streaming analytics using open source technologies☆25Mar 2, 2023Updated 3 years ago
- Data pipeline for extracting, transforming, and visualising Covid-19 data☆14Apr 23, 2023Updated 3 years ago
- Public Docker Images for popular services☆59Sep 13, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- CDC with NiFi, Kafka Connect, Flink SQL, Cloudera Data in Motion☆11Sep 14, 2023Updated 3 years ago
- ☆17Apr 1, 2024Updated 2 years ago
- This repository contains an Apache Flink application for real-time sales analytics built using Docker Compose to orchestrate the necessar…☆53Dec 4, 2023Updated 2 years ago
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆43Sep 26, 2023Updated 3 years ago
- Traditionally, engineers were needed to implement business logic via data pipelines before business users can start using it. Using this …☆12Oct 26, 2026Updated last week
- Parameter Importance according to OpenML☆14Feb 23, 2022Updated 4 years ago
- Spark Notebook docker image☆10Dec 29, 2017Updated 8 years ago