aws-samples / eks-spark-benchmark
Performance optimization for Spark running on Kubernetes
☆87Updated 4 years ago
Alternatives and similar repositories for eks-spark-benchmark:
Users that are interested in eks-spark-benchmark are comparing it to the libraries listed below
- The Internals of Spark on Kubernetes☆71Updated 2 years ago
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆176Updated last year
- Setup for running Trino with Hive Metastore on Kubernetes☆101Updated 2 years ago
- Apache Spark Kubernetes Operator☆111Updated this week
- Helm charts for Trino and Trino Gateway☆162Updated 2 weeks ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆83Updated 5 years ago
- Operator for managing the Spark clusters on Kubernetes and OpenShift.☆158Updated 3 years ago
- ☆13Updated 5 months ago
- Docker image for Spark history server on Kubernetes☆15Updated 5 years ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆98Updated 2 years ago
- Airflow on Kubernetes Operator☆89Updated 2 years ago
- Spark metrics related custom classes and sinks (e.g. Prometheus)☆180Updated 2 years ago
- DynoYARN is a framework to run simulated YARN clusters and workloads for YARN scale testing.☆59Updated 2 years ago
- ☆79Updated last year
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆88Updated last year
- ☆40Updated last year
- This project provides fully automated one-click experience to create Cloud and Kubernetes environment to run Data Analytics workload like…☆55Updated 2 years ago
- Rocksdb state storage implementation for Structured Streaming.☆17Updated 4 years ago
- Spark on Kubernetes infrastructure Helm charts repo☆199Updated 2 years ago
- The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…☆214Updated 3 weeks ago
- Examples and custom spark images for working with the spark-on-k8s operator on AWS☆27Updated 4 years ago
- Spark on Kubernetes infrastructure Docker images repo☆37Updated 2 years ago
- The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them☆135Updated last year
- Apache YuniKorn Release☆38Updated 3 weeks ago
- ☆27Updated 3 weeks ago
- Kubernetes (K8s) Operator for PrestoDB☆46Updated 3 years ago
- The Internals of Delta Lake☆183Updated 3 months ago
- Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…☆120Updated 2 weeks ago
- This project provides a reverse proxy for Spark UI on Kubernetes☆14Updated last year
- Lightweight proxy to expose the UI of an Apache Spark cluster that is behind a firewall☆98Updated 4 years ago