jobmthomas / Docker-Bigdata
☆24Updated 3 years ago
Alternatives and similar repositories for Docker-Bigdata:
Users that are interested in Docker-Bigdata are comparing it to the libraries listed below
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆53Updated last year
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆97Updated 2 years ago
- Spark Examples☆125Updated 3 years ago
- Base Docker image with just essentials: Hadoop, Hive and Spark.☆68Updated 4 years ago
- ETL pipeline using pyspark (Spark - Python)☆112Updated 4 years ago
- Apache Spark Course Material☆87Updated last year
- Multi-stage, config driven, SQL based ETL framework using PySpark☆25Updated 5 years ago
- DataQuality for BigData☆143Updated last year
- Smart Automation Tool for building modern Data Lakes and Data Pipelines☆118Updated last week
- ☆27Updated 4 years ago
- Code for docker images☆39Updated last year
- Spline agent for Apache Spark☆191Updated 2 weeks ago
- Spark data pipeline that processes movie ratings data.☆28Updated 3 weeks ago
- Data Engineering with Spark and Delta Lake☆95Updated 2 years ago
- spark on kubernetes☆105Updated 2 years ago
- Delta-Lake, ETL, Spark, Airflow☆46Updated 2 years ago
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆74Updated this week
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 2 years ago
- Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi☆112Updated last year
- Educational notes,Hands on problems w/ solutions for hadoop ecosystem☆87Updated 6 years ago
- This repository contains code for Spark Streaming☆21Updated 3 years ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- Delta Lake examples☆217Updated 4 months ago
- This Apache Atlas is built from the latest release source tarball and patched to be run in a Docker container.☆138Updated last year
- O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian☆211Updated last year
- A data pipeline moving data from a Relational database system (RDBMS) to a Hadoop file system (HDFS).☆15Updated 3 years ago
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆72Updated 3 years ago
- Apache Spark 3 - Structured Streaming Course Material☆121Updated last year
- Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker.☆478Updated 2 years ago
- PySpark data-pipeline testing and CICD☆28Updated 4 years ago