amesar / docker-spark-hive-metastore
Spark and Hive docker containers sharing a common MySQL metastore
☆26Updated 4 years ago
Alternatives and similar repositories for docker-spark-hive-metastore:
Users that are interested in docker-spark-hive-metastore are comparing it to the libraries listed below
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- Magic to help Spark pipelines upgrade☆34Updated 4 months ago
- Base Docker image with just essentials: Hadoop, Hive and Spark.☆68Updated 4 years ago
- Examples of Spark 3.0☆46Updated 4 years ago
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 2 years ago
- Docker multi-nodes Hadoop cluster with Spark 2.4.1 on Yarn☆50Updated 4 years ago
- ☆63Updated 5 years ago
- Spark on Kubernetes using Helm☆34Updated 4 years ago
- Code snippets for Data Engineering Design Patterns book☆69Updated 2 weeks ago
- Sample processing code using Spark 2.1+ and Scala☆51Updated 4 years ago
- Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.☆75Updated 9 months ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆97Updated 2 years ago
- The Internals of Spark on Kubernetes☆70Updated 2 years ago
- ☆14Updated 5 years ago
- A pyspark lib to validate data quality☆18Updated 2 years ago
- A simple Spark-powered ETL framework that just works 🍺☆179Updated 2 weeks ago
- Smart Automation Tool for building modern Data Lakes and Data Pipelines☆118Updated last week
- Scalable CDC Pattern Implemented using PySpark☆18Updated 5 years ago
- Spark Examples☆125Updated 3 years ago
- A Python Library to support running data quality rules while the spark job is running⚡☆172Updated this week
- The Internals of Delta Lake☆183Updated last month
- Quickstart PySpark with Anaconda on AWS/EMR using Terraform☆47Updated last month
- Presto Trino with Apache Hive Postgres metastore☆39Updated 5 months ago
- spark on kubernetes☆105Updated 2 years ago
- ☆47Updated 6 months ago
- Flowchart for debugging Spark applications☆104Updated 4 months ago
- Data validation library for PySpark 3.0.0☆34Updated 2 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆53Updated last year
- Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work☆48Updated 2 years ago
- Quick Guides from Dremio on Several topics☆67Updated last month