Performance optimization for Spark running on Kubernetes
☆87Aug 18, 2020Updated 5 years ago
Alternatives and similar repositories for eks-spark-benchmark
Users that are interested in eks-spark-benchmark are comparing it to the libraries listed below
Sorting:
- Apache YuniKorn Release☆44Mar 12, 2026Updated last week
- Airflow on Kubernetes Operator☆86Feb 6, 2023Updated 3 years ago
- Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.☆3,106Updated this week
- Kubeflow workshop on EKS. Mainly focus on AWS integration examples. Please go check kubeflow website http://kubeflow.org for other exampl…☆100Dec 30, 2020Updated 5 years ago
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆177Apr 23, 2023Updated 2 years ago
- Docker image for Spark history server on Kubernetes☆15Mar 13, 2020Updated 6 years ago
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆335Sep 29, 2023Updated 2 years ago
- Apache ORC - the smallest, fastest columnar storage for Hadoop workloads☆16Feb 18, 2026Updated last month
- Course content for Practical AI on the Google Cloud Platform☆11Aug 4, 2020Updated 5 years ago
- ☆18Jun 16, 2024Updated last year
- Bits of code I use during live demos☆30Dec 19, 2024Updated last year
- benchmark-for-spark☆18May 7, 2025Updated 10 months ago
- Linkedin's Cruise Control container image built for Koperator (https://github.com/banzaicloud/koperator)☆13Oct 14, 2023Updated 2 years ago
- A stress testing tool for the scheduler in a large-scale scenario.☆16Apr 29, 2024Updated last year
- Firekube distro with COVID-Net ML☆18Feb 8, 2021Updated 5 years ago
- The gateway component to make Spark on K8s much easier for Spark users.☆216Dec 16, 2025Updated 3 months ago
- Benchmarking tools for JupyterLab☆12Jun 11, 2023Updated 2 years ago
- ☆13Mar 4, 2026Updated 2 weeks ago
- The proposed solution shows and approach to unify and centralize logs across different compute platforms like EC2, ECS, EKS and Lambda wi…☆14Oct 17, 2023Updated 2 years ago
- Apache YuniKorn K8shim☆163Updated this week
- Apache Spark Connect Client for Swift☆30Updated this week
- Jupyter extensions for SWAN☆60Updated this week
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆95May 9, 2025Updated 10 months ago
- Fate operator☆51Feb 22, 2024Updated 2 years ago
- [DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆656Sep 2, 2022Updated 3 years ago
- Pandas helper functions☆31Feb 19, 2023Updated 3 years ago
- A protobuf serde for Kafbat UI using a protobuf descriptor file☆17Dec 4, 2025Updated 3 months ago
- This is an activator project for showcasing how to read & write data from Kafka-cluster using Scala Producer & Consumer API.☆11May 28, 2017Updated 8 years ago
- ☆23Feb 25, 2026Updated 3 weeks ago
- Best practices and recommendations for getting started with Amazon EMR on EKS.☆68Jan 27, 2026Updated last month
- WIP - Scaling Spark Data Platform with EKS. The solution uses Karpenter and Cluster Autoscaler, Yunikorn for advanced scheduling.☆16May 9, 2023Updated 2 years ago
- This is an activator project for showcasing how to read & write data from Kafka-cluster using Java Producer & Consumer API.☆11May 24, 2017Updated 8 years ago
- Terraform provider for hosted Deno APIs☆16Mar 18, 2025Updated last year
- DoEKS is a tool to build, deploy and scale Data Platforms on Amazon EKS☆831Updated this week
- Repository for Practical Data Pipeline Code☆11Feb 19, 2022Updated 4 years ago
- Apache YuniKorn Core☆1,004Updated this week
- Benchmarking code for evaluating the cost of cache coherence protocols implemented on different platforms☆14Apr 13, 2021Updated 4 years ago
- A Spark datasource for the HadoopCryptoLedger library☆13Sep 29, 2025Updated 5 months ago
- A JupyterHub authenticator using Kerberos☆12Jul 16, 2019Updated 6 years ago