aws-samples / eks-spark-benchmark
Performance optimization for Spark running on Kubernetes
☆84Updated 4 years ago
Related projects: ⓘ
- The Internals of Spark on Kubernetes☆71Updated 2 years ago
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆175Updated last year
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆81Updated 4 years ago
- Setup for running Trino with Hive Metastore on Kubernetes☆98Updated 2 years ago
- Apache Spark Kubernetes Operator☆48Updated this week
- DynoYARN is a framework to run simulated YARN clusters and workloads for YARN scale testing.☆58Updated last year
- This project provides fully automated one-click experience to create Cloud and Kubernetes environment to run Data Analytics workload like…☆52Updated last year
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆96Updated last year
- Docker image for Spark history server on Kubernetes☆15Updated 4 years ago
- ☆142Updated last week
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆82Updated 5 months ago
- Spark on Kubernetes infrastructure Helm charts repo☆199Updated last year
- ☆39Updated last year
- Examples and custom spark images for working with the spark-on-k8s operator on AWS☆27Updated 3 years ago
- Operator for managing the Spark clusters on Kubernetes and OpenShift.☆156Updated 2 years ago
- The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…☆201Updated 4 months ago
- TPC-DS benchmark kit with some modifications/fixes☆85Updated last month
- This project provides a reverse proxy for Spark UI on Kubernetes☆14Updated 11 months ago
- ☆12Updated 3 months ago
- Airflow on Kubernetes Operator☆89Updated last year
- The gateway component to make Spark on K8s much easier for Spark users.☆178Updated 2 months ago
- Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…☆111Updated last month
- Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆188Updated 3 weeks ago
- The Internals of Delta Lake☆180Updated last month
- REST API for Apache Spark on K8S or YARN☆89Updated last week
- Spark metrics related custom classes and sinks (e.g. Prometheus)☆175Updated 2 years ago
- Spline agent for Apache Spark☆183Updated last week
- The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them☆135Updated 10 months ago
- Kubernetes (K8s) Operator for PrestoDB☆45Updated 2 years ago
- A library for Spark DataFrame using MinIO Select API☆96Updated 4 years ago