Performance optimization for Spark running on Kubernetes
☆87Aug 18, 2020Updated 6 years ago
Alternatives and similar repositories for eks-spark-benchmark
Users that are interested in eks-spark-benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17Jul 28, 2026Updated last month
- Airflow on Kubernetes Operator☆86Feb 6, 2023Updated 3 years ago
- Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.☆3,154Updated this week
- Kubeflow workshop on EKS. Mainly focus on AWS integration examples. Please go check kubeflow website http://kubeflow.org for other exampl…☆100Dec 30, 2020Updated 5 years ago
- Apache YuniKorn Release☆49Sep 12, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆179Apr 23, 2023Updated 3 years ago
- All the things about TPC-DS in Apache Spark☆110Jun 15, 2023Updated 3 years ago
- Docker image for Spark history server on Kubernetes☆15Mar 13, 2020Updated 6 years ago
- Apache Spark Connect Client for Swift☆33Updated this week
- ☆26Apr 26, 2026Updated 4 months ago
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆335Sep 29, 2023Updated 2 years ago
- ☆18Jun 16, 2024Updated 2 years ago
- Course content for Practical AI on the Google Cloud Platform☆11Aug 4, 2020Updated 6 years ago
- benchmark-for-spark☆19May 7, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Linkedin's Cruise Control container image built for Koperator (https://github.com/banzaicloud/koperator)☆13Oct 14, 2023Updated 2 years ago
- Firekube distro with COVID-Net ML☆18Feb 8, 2021Updated 5 years ago
- The gateway component to make Spark on K8s much easier for Spark users.☆221May 6, 2026Updated 4 months ago
- ☆13Jul 28, 2026Updated last month
- Apache YuniKorn K8shim☆167Updated this week
- This project provides a reverse proxy for Spark UI on Kubernetes☆16Oct 12, 2023Updated 2 years ago
- A stress testing tool for the scheduler in a large-scale scenario.☆16Apr 29, 2024Updated 2 years ago
- Apache Spark Kubernetes Operator☆323Updated this week
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆96May 11, 2026Updated 4 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆19May 7, 2026Updated 4 months ago
- Fate operator☆50Feb 22, 2024Updated 2 years ago
- [DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆655Sep 2, 2022Updated 4 years ago
- This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apach…☆19Jun 23, 2016Updated 10 years ago
- MCP Server and CLI for Apache Spark History Server. Debug Spark applications from AI agents, scripts, or the terminal.☆199Updated this week
- Best practices and recommendations for getting started with Amazon EMR on EKS.☆70Sep 10, 2026Updated last week
- ☆22Aug 27, 2026Updated 3 weeks ago
- Operator to provide Kafka Schema in declarative way using KubernetesCustomResources☆10Oct 22, 2024Updated last year
- Base hadoop/spark/bigdata image with advanced config loading scripts.☆11Nov 3, 2020Updated 5 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- DoEKS is a tool to build, deploy and scale Data Platforms on Amazon EKS☆857Sep 10, 2026Updated last week
- Multi-stage, config driven, SQL based ETL framework using PySpark☆26Sep 16, 2019Updated 7 years ago
- A very basic app written in Javascript and packaged as a Docker image to be used as a demo when testing clustered deployments in ECS/EKS.☆11Jun 30, 2023Updated 3 years ago
- Apache YuniKorn Core☆1,029Updated this week
- WIP - Scaling Spark Data Platform with EKS. The solution uses Karpenter and Cluster Autoscaler, Yunikorn for advanced scheduling.☆16May 9, 2023Updated 3 years ago
- A JupyterHub authenticator using Kerberos☆12Sep 1, 2026Updated 2 weeks ago
- Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.☆1,066Updated this week