developerhq / spark-kubernetes
Deploy your Spark Production Cluster on Kubernetes
☆47Updated 4 years ago
Alternatives and similar repositories for spark-kubernetes:
Users that are interested in spark-kubernetes are comparing it to the libraries listed below
- spark on kubernetes☆105Updated 2 years ago
- Spark on Kubernetes using Helm☆34Updated 4 years ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆98Updated 2 years ago
- The Internals of Spark on Kubernetes☆71Updated 2 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- ☆40Updated last year
- A testing framework for Trino☆26Updated last month
- Rocksdb state storage implementation for Structured Streaming.☆17Updated 4 years ago
- Performance optimization for Spark running on Kubernetes☆87Updated 4 years ago
- Bootstrap a pipeline on the BDE platform☆26Updated 8 years ago
- This repository contains recipes for Apache Pinot.☆30Updated 2 months ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆83Updated 5 years ago
- Multiple node presto cluster on docker container☆124Updated 2 years ago
- Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline☆75Updated 2 years ago
- Examples of Spark 3.0☆47Updated 4 years ago
- Ambari stack service for installing and managing Apache Airflow on HDP cluster☆59Updated 6 years ago
- ☆24Updated 7 months ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆174Updated last year
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- ☆80Updated 2 weeks ago
- Takes a kafka stream into spark, apply transformations and sink into Druid. Everything Dockerised.☆30Updated last year
- ☆63Updated 5 years ago
- Setup for running Trino with Hive Metastore on Kubernetes☆101Updated 2 years ago
- A library for Spark DataFrame using MinIO Select API☆98Updated 5 years ago
- Apache Flink (Pyflink) and Related Projects☆37Updated 3 weeks ago
- Interactive Notebooks that support the book☆40Updated 4 years ago
- Sample processing code using Spark 2.1+ and Scala☆52Updated 4 years ago
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆120Updated 3 years ago
- ☆24Updated 4 years ago
- Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub☆37Updated 7 years ago