aws-samples / eks-spark-benchmark
Performance optimization for Spark running on Kubernetes
☆87Updated 4 years ago
Alternatives and similar repositories for eks-spark-benchmark:
Users that are interested in eks-spark-benchmark are comparing it to the libraries listed below
- The Internals of Spark on Kubernetes☆71Updated 2 years ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆83Updated 5 years ago
- Setup for running Trino with Hive Metastore on Kubernetes☆101Updated 2 years ago
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆176Updated 2 years ago
- The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…☆219Updated last month
- This project provides fully automated one-click experience to create Cloud and Kubernetes environment to run Data Analytics workload like…☆55Updated 2 years ago
- Apache Spark Kubernetes Operator☆114Updated this week
- ☆40Updated last year
- Spark on Kubernetes infrastructure Helm charts repo☆200Updated 2 years ago
- Operator for managing the Spark clusters on Kubernetes and OpenShift.☆158Updated 3 years ago
- Airflow on Kubernetes Operator☆89Updated 2 years ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆98Updated 2 years ago
- DynoYARN is a framework to run simulated YARN clusters and workloads for YARN scale testing.☆60Updated 2 years ago
- Docker image for Spark history server on Kubernetes☆15Updated 5 years ago
- ☆13Updated 6 months ago
- Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…☆121Updated last month
- The gateway component to make Spark on K8s much easier for Spark users.☆188Updated this week
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆89Updated last year
- This project provides a reverse proxy for Spark UI on Kubernetes☆14Updated last year
- Kubernetes (K8s) Operator for PrestoDB☆46Updated 3 years ago
- Helm charts for Trino and Trino Gateway☆164Updated this week
- Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.☆88Updated last year
- Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆213Updated last week
- The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them☆135Updated last year
- The Internals of Delta Lake☆183Updated 3 months ago
- Rocksdb state storage implementation for Structured Streaming.☆17Updated 4 years ago
- Spark on Kubernetes infrastructure Docker images repo☆37Updated 2 years ago
- Spark metrics related custom classes and sinks (e.g. Prometheus)☆181Updated 2 years ago
- Spline agent for Apache Spark☆191Updated this week
- ACID Data Source for Apache Spark based on Hive ACID☆97Updated 3 years ago