Performance optimization for Spark running on Kubernetes
☆87Aug 18, 2020Updated 5 years ago
Alternatives and similar repositories for eks-spark-benchmark
Users that are interested in eks-spark-benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Utility for benchmarking changes in Spark using TPC-DS workloads☆16Jun 3, 2021Updated 5 years ago
- Apache YuniKorn Release☆45Updated this week
- ☆17Apr 9, 2024Updated 2 years ago
- Airflow on Kubernetes Operator☆86Feb 6, 2023Updated 3 years ago
- Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.☆3,128Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Kubeflow workshop on EKS. Mainly focus on AWS integration examples. Please go check kubeflow website http://kubeflow.org for other exampl…☆100Dec 30, 2020Updated 5 years ago
- All the things about TPC-DS in Apache Spark☆111Jun 15, 2023Updated 3 years ago
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆179Apr 23, 2023Updated 3 years ago
- Docker image for Spark history server on Kubernetes☆15Mar 13, 2020Updated 6 years ago
- ☆26Apr 26, 2026Updated 2 months ago
- ☆12Jun 10, 2024Updated 2 years ago
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆335Sep 29, 2023Updated 2 years ago
- Course content for Practical AI on the Google Cloud Platform☆11Aug 4, 2020Updated 5 years ago
- Bits of code I use during live demos☆30Dec 19, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- This project describes how to write full ETL data pipeline using spark.☆15Oct 15, 2022Updated 3 years ago
- benchmark-for-spark☆19May 7, 2025Updated last year
- Linkedin's Cruise Control container image built for Koperator (https://github.com/banzaicloud/koperator)☆13Oct 14, 2023Updated 2 years ago
- A CLI tool to simulate EC2 Spot Instances interruptions using AWS Fault Injection Simulator.☆12May 4, 2022Updated 4 years ago
- Firekube distro with COVID-Net ML☆18Feb 8, 2021Updated 5 years ago
- The gateway component to make Spark on K8s much easier for Spark users.☆220May 6, 2026Updated last month
- ☆13Mar 4, 2026Updated 3 months ago
- The proposed solution shows and approach to unify and centralize logs across different compute platforms like EC2, ECS, EKS and Lambda wi…☆14Oct 17, 2023Updated 2 years ago
- Apache YuniKorn K8shim☆163Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This project provides a reverse proxy for Spark UI on Kubernetes☆16Oct 12, 2023Updated 2 years ago
- ☆11Mar 28, 2024Updated 2 years ago
- Jupyter extensions for SWAN☆60Jun 12, 2026Updated 2 weeks ago
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆96May 11, 2026Updated last month
- Apache Spark Kubernetes Operator☆290Updated this week
- Fate operator☆50Feb 22, 2024Updated 2 years ago
- [DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆654Sep 2, 2022Updated 3 years ago
- This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apach…☆19Jun 23, 2016Updated 10 years ago
- Pandas helper functions☆31Feb 19, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A protobuf serde for Kafbat UI using a protobuf descriptor file☆17Dec 4, 2025Updated 6 months ago
- ☆22Apr 28, 2026Updated 2 months ago
- Best practices and recommendations for getting started with Amazon EMR on EKS.☆70May 4, 2026Updated last month
- WIP - Scaling Spark Data Platform with EKS. The solution uses Karpenter and Cluster Autoscaler, Yunikorn for advanced scheduling.☆16May 9, 2023Updated 3 years ago
- Terraform provider for hosted Deno APIs☆16Mar 18, 2025Updated last year
- Multi-stage, config driven, SQL based ETL framework using PySpark☆26Sep 16, 2019Updated 6 years ago
- DoEKS is a tool to build, deploy and scale Data Platforms on Amazon EKS☆851Jun 22, 2026Updated last week