aws-samples / eks-spark-benchmark
Performance optimization for Spark running on Kubernetes
☆86Updated 4 years ago
Alternatives and similar repositories for eks-spark-benchmark:
Users that are interested in eks-spark-benchmark are comparing it to the libraries listed below
- The Internals of Spark on Kubernetes☆70Updated 2 years ago
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆176Updated last year
- Setup for running Trino with Hive Metastore on Kubernetes☆99Updated 2 years ago
- This project provides fully automated one-click experience to create Cloud and Kubernetes environment to run Data Analytics workload like…☆53Updated 2 years ago
- Apache Spark Kubernetes Operator☆94Updated this week
- Docker image for Spark history server on Kubernetes☆15Updated 4 years ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆82Updated 4 years ago
- Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…☆118Updated 3 weeks ago
- Airflow on Kubernetes Operator☆89Updated 2 years ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆97Updated 2 years ago
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆86Updated 10 months ago
- Helm charts for Trino and Trino Gateway☆158Updated this week
- Operator for managing the Spark clusters on Kubernetes and OpenShift.☆157Updated 3 years ago
- DynoYARN is a framework to run simulated YARN clusters and workloads for YARN scale testing.☆58Updated last year
- ☆40Updated last year
- ☆13Updated 3 months ago
- The gateway component to make Spark on K8s much easier for Spark users.☆184Updated 3 weeks ago
- The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…☆211Updated 9 months ago
- Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆206Updated this week
- Spline agent for Apache Spark☆191Updated 2 weeks ago
- Rocksdb state storage implementation for Structured Streaming.☆17Updated 4 years ago
- Apache YuniKorn Release☆35Updated last week
- Spark on Kubernetes infrastructure Helm charts repo☆198Updated 2 years ago
- ☆79Updated last year
- The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them☆135Updated last year
- Kubernetes (K8s) Operator for PrestoDB☆46Updated 3 years ago
- Apache YuniKorn Scheduler Interface☆27Updated 3 weeks ago
- Spark on Kubernetes infrastructure Docker images repo☆37Updated 2 years ago
- Spark ETL example processing New York taxi rides public dataset on EKS☆44Updated 2 years ago
- Enables synchronizing metadata changes (Create/Drop table/partition) from Hive Metastore to AWS Glue Data Catalog☆35Updated last year