apple / batch-processing-gateway
The gateway component to make Spark on K8s much easier for Spark users.
☆178Updated 2 months ago
Related projects: ⓘ
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆321Updated 11 months ago
- Apache Spark Kubernetes Operator☆48Updated this week
- ☆144Updated this week
- Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆188Updated 3 weeks ago
- Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…☆111Updated last month
- ☆142Updated last week
- A load balancer / proxy / gateway for prestodb☆356Updated last month
- Performance optimization for Spark running on Kubernetes☆84Updated 4 years ago
- This project provides fully automated one-click experience to create Cloud and Kubernetes environment to run Data Analytics workload like…☆52Updated last year
- The Internals of Spark on Kubernetes☆71Updated 2 years ago
- A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.☆341Updated 3 months ago
- DynoYARN is a framework to run simulated YARN clusters and workloads for YARN scale testing.☆58Updated last year
- The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them☆135Updated 10 months ago
- REST API for Apache Spark on K8S or YARN☆89Updated last week
- Simple project to expose a catalog over REST using a Java catalog backend☆102Updated this week
- A S3 Shuffle plugin for Apache Spark to enable elastic scaling for generic Spark workloads.☆37Updated 4 months ago
- Repository of helm charts for deploying DataHub on a Kubernetes cluster☆160Updated 2 weeks ago
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆175Updated last year
- LST-Bench is a framework that allows users to run benchmarks specifically designed for evaluating Log-Structured Tables (LSTs) such as De…☆64Updated last week
- Setup for running Trino with Hive Metastore on Kubernetes☆98Updated 2 years ago
- Apache Iceberg Documentation Site☆42Updated 7 months ago
- Replicates any database (CDC events) to Apache Iceberg (To Cloud Storage)☆179Updated this week
- ☆39Updated last year
- ☆197Updated last month
- Sparglim✨ makes PySpark App Configurable and Deploy Spark Connect Server Easier!☆35Updated last month
- Druid Kubernetes Operator☆205Updated 3 months ago
- A playground to experience Gravitino☆25Updated last week
- CLI tool to bulk migrate the tables from one catalog another without a data copy☆51Updated this week
- A client for connecting and running DDLs on hive metastore.☆51Updated 5 months ago
- ☆77Updated last year