Performance optimization for Spark running on Kubernetes
☆87Aug 18, 2020Updated 5 years ago
Alternatives and similar repositories for eks-spark-benchmark
Users that are interested in eks-spark-benchmark are comparing it to the libraries listed below
Sorting:
- Utility for benchmarking changes in Spark using TPC-DS workloads☆16Jun 3, 2021Updated 4 years ago
- All the things about TPC-DS in Apache Spark☆109Jun 15, 2023Updated 2 years ago
- ☆12Jun 10, 2024Updated last year
- Airflow on Kubernetes Operator☆87Feb 6, 2023Updated 3 years ago
- Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.☆3,106Updated this week
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆177Apr 23, 2023Updated 2 years ago
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆334Sep 29, 2023Updated 2 years ago
- A protobuf serde for Kafbat UI using a protobuf descriptor file☆17Dec 4, 2025Updated 2 months ago
- Linkedin's Cruise Control container image built for Koperator (https://github.com/banzaicloud/koperator)☆13Oct 14, 2023Updated 2 years ago
- The proposed solution shows and approach to unify and centralize logs across different compute platforms like EC2, ECS, EKS and Lambda wi…☆14Oct 17, 2023Updated 2 years ago
- Kubeflow workshop on EKS. Mainly focus on AWS integration examples. Please go check kubeflow website http://kubeflow.org for other exampl…☆100Dec 30, 2020Updated 5 years ago
- A Spark datasource for the HadoopCryptoLedger library☆13Sep 29, 2025Updated 5 months ago
- A CLI tool to simulate EC2 Spot Instances interruptions using AWS Fault Injection Simulator.☆12May 4, 2022Updated 3 years ago
- ☆17Apr 9, 2024Updated last year
- The gateway component to make Spark on K8s much easier for Spark users.☆215Dec 16, 2025Updated 2 months ago
- This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apach…☆19Jun 23, 2016Updated 9 years ago
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆62Sep 6, 2024Updated last year
- Alcide Kubernetes Advisor ... Cluster Hygiene & Security Scanner - Pipeline Integration☆40Mar 18, 2021Updated 4 years ago
- Jupyter extensions for SWAN☆59Updated this week
- 💰 Get Real-Time Cryptocurrency Price and Up-to-Date Status in your Alfred Workflow☆17Jun 21, 2025Updated 8 months ago
- Docker image for Spark history server on Kubernetes☆15Mar 13, 2020Updated 5 years ago
- [DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆658Sep 2, 2022Updated 3 years ago
- A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.☆347May 31, 2024Updated last year
- Amazon Kinesis Data Analytics Flink Starter Kit helps you with the development of Flink Application with Kinesis Stream as a source and A…☆47Aug 30, 2023Updated 2 years ago
- A stress testing tool for the scheduler in a large-scale scenario.☆16Apr 29, 2024Updated last year
- benchmark-for-spark☆18May 7, 2025Updated 9 months ago
- This project provides a reverse proxy for Spark UI on Kubernetes☆17Oct 12, 2023Updated 2 years ago
- Hadoop output committers for S3☆113Jul 9, 2020Updated 5 years ago
- ☆18Jun 16, 2024Updated last year
- Paper: A Zero-rename committer for object stores☆20Nov 7, 2025Updated 3 months ago
- Microsoft Azure Data Lake Store Filesystem Library for Java☆21Dec 19, 2025Updated 2 months ago
- Firekube distro with COVID-Net ML☆18Feb 8, 2021Updated 5 years ago
- Spark to Tableau Extractor library☆19Oct 23, 2017Updated 8 years ago
- Delta lake and filesystem helper methods☆50Feb 29, 2024Updated 2 years ago
- Apache YuniKorn Core☆1,002Updated this week
- A powerful Laravel storage driver that enables seamless synchronization of files across multiple disks, with an integrated cache disk for…☆15Nov 11, 2025Updated 3 months ago
- Apache Spark Kubernetes Operator☆263Updated this week
- Fate operator☆51Feb 22, 2024Updated 2 years ago
- Spark ETL example processing New York taxi rides public dataset on EKS☆44Jan 5, 2023Updated 3 years ago