developerhq / spark-kubernetes
Deploy your Spark Production Cluster on Kubernetes
☆47Updated 4 years ago
Alternatives and similar repositories for spark-kubernetes:
Users that are interested in spark-kubernetes are comparing it to the libraries listed below
- spark on kubernetes☆105Updated last year
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆97Updated last year
- The Internals of Spark on Kubernetes☆70Updated 2 years ago
- Spark on Kubernetes using Helm☆34Updated 4 years ago
- ☆40Updated last year
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- Spark 3.0.0 Structured Streaming Kafka Avro Demo☆15Updated last year
- A library that brings useful functions from various modern database management systems to Apache Spark☆58Updated last year
- ☆47Updated 5 months ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆81Updated 4 years ago
- Spark on Kubernetes infrastructure Helm charts repo☆200Updated 2 years ago
- Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline☆74Updated last year
- Multi docker container images for main Big Data Tools. (Hadoop, Spark, Kafka, HBase, Cassandra, Zookeeper, Zeppelin, Drill, Flink, Hive, …☆34Updated last month
- Performance optimization for Spark running on Kubernetes☆85Updated 4 years ago
- Rocksdb state storage implementation for Structured Streaming.☆17Updated 4 years ago
- Examples of Spark 3.0☆47Updated 4 years ago
- Setup for running Trino with Hive Metastore on Kubernetes☆99Updated 2 years ago
- Code for the deployment of Hadoop clusters, written in Bourne or Bourne Again shell.☆34Updated last year
- This project provides a reverse proxy for Spark UI on Kubernetes☆14Updated last year
- Apiary provides modules which can be combined to create a federated cloud data lake☆36Updated 9 months ago
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆28Updated 3 weeks ago
- ☆63Updated 5 years ago
- Docker image for Apache Hive Metastore☆71Updated last year
- ☆79Updated last year
- ☆25Updated 4 months ago
- Presto Trino with Apache Hive Postgres metastore☆38Updated 4 months ago
- Spark Structured Streaming State Tools☆34Updated 4 years ago
- Sample processing code using Spark 2.1+ and Scala☆51Updated 4 years ago