The gateway component to make Spark on K8s much easier for Spark users.
☆212Dec 16, 2025Updated 2 months ago
Alternatives and similar repositories for batch-processing-gateway
Users that are interested in batch-processing-gateway are comparing it to the libraries listed below
Sorting:
- Apache YuniKorn Release☆44Updated this week
- Apache Spark Kubernetes Operator☆263Updated this week
- Community Java bindings for https://github.com/facebookincubator/velox☆39Updated this week
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆334Sep 29, 2023Updated 2 years ago
- Uniffle is a high performance, general purpose Remote Shuffle Service.☆446Feb 12, 2026Updated 2 weeks ago
- Apache YuniKorn Core☆1,002Updated this week
- ☆23Oct 12, 2022Updated 3 years ago
- Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.☆3,102Feb 18, 2026Updated last week
- Repository accompanying the Interspeech 2022 publication titled "Space-Efficient Representation of Entity-centric Query Language Models" …☆13Sep 8, 2022Updated 3 years ago
- Apache YuniKorn Web UI☆40Updated this week
- Apache Flink Kubernetes Operator☆987Feb 18, 2026Updated last week
- Client libraries of end users of Apache Kyuubi☆11Jan 10, 2023Updated 3 years ago
- ☆14Nov 5, 2025Updated 3 months ago
- Apache DataFusion Comet Spark Accelerator☆1,142Feb 20, 2026Updated last week
- Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.☆1,039Feb 19, 2026Updated last week
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,516Updated this week
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,304Updated this week
- Performance optimization for Spark running on Kubernetes☆87Aug 18, 2020Updated 5 years ago
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆17Jan 4, 2026Updated last month
- Apache YuniKorn K8shim☆163Feb 10, 2026Updated 2 weeks ago
- Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…☆134Jan 5, 2026Updated last month
- Apache Iceberg Documentation Site☆42Feb 5, 2024Updated 2 years ago
- Apache YuniKorn Scheduler Interface☆34Updated this week
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆177Apr 23, 2023Updated 2 years ago
- A sample implementation of stream writes to an Iceberg table on GCS using Flink and reading it using Trino☆22May 30, 2022Updated 3 years ago
- This repository contains the official implementation for the ECCV'22 paper, "SPIN: An Empirical Evaluation on Sharing Parameters of Isotr…☆20Sep 9, 2023Updated 2 years ago
- This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spa…☆815Feb 5, 2026Updated 3 weeks ago
- Apache Yunikorn website - see the master branch for instructions☆30Feb 11, 2026Updated 2 weeks ago
- Operator for managing the Spark clusters on Kubernetes and OpenShift.☆159Nov 18, 2021Updated 4 years ago
- Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Stor…☆41Dec 14, 2022Updated 3 years ago
- This project provides a reverse proxy for Spark UI on Kubernetes☆17Oct 12, 2023Updated 2 years ago
- Remote Shuffle Service for Flink☆191Jan 6, 2023Updated 3 years ago
- Benchmarks for queries over continuous data streams.☆376Dec 26, 2025Updated 2 months ago
- ☆27Jan 8, 2026Updated last month
- HashCats Auto Clicker is a versatile tool that enhances your gaming experience by automating various actions within the HashCats game☆18Updated this week
- Dashboard for operating Flink jobs and deployments.☆44Jan 31, 2026Updated last month
- ☆23Apr 28, 2022Updated 3 years ago
- Data Sketches for Apache Spark☆22Dec 22, 2022Updated 3 years ago
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆1,845Feb 20, 2026Updated last week