apache / spark-kubernetes-operator
Apache Spark Kubernetes Operator
☆95Updated this week
Alternatives and similar repositories for spark-kubernetes-operator:
Users that are interested in spark-kubernetes-operator are comparing it to the libraries listed below
- The gateway component to make Spark on K8s much easier for Spark users.☆186Updated last month
- Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…☆119Updated this week
- Apache Iceberg Documentation Site☆42Updated last year
- The Internals of Spark on Kubernetes☆70Updated 2 years ago
- Helm charts for Trino and Trino Gateway☆159Updated last week
- CLI tool to bulk migrate the tables from one catalog another without a data copy☆76Updated this week
- Storage connector for Trino☆104Updated last week
- ☆184Updated this week
- Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆206Updated this week
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆327Updated last year
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆87Updated 11 months ago
- Performance optimization for Spark running on Kubernetes☆86Updated 4 years ago
- ☆40Updated last year
- Framework for running macro benchmarks in a clustered environment☆32Updated 2 weeks ago
- Apache flink☆143Updated this week
- A re-implementation of Hadoop DistCP in Apache Spark☆47Updated last year
- Trino Connector for Apache Paimon.☆31Updated 2 months ago
- REST API for Apache Spark on K8S or YARN☆95Updated this week
- A S3 Shuffle plugin for Apache Spark to enable elastic scaling for generic Spark workloads.☆38Updated 9 months ago
- A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Ap…☆299Updated last year
- Official Dockerfile for Apache Spark☆126Updated this week
- Spline agent for Apache Spark☆191Updated last month
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆97Updated 2 years ago
- Apache Flink Stateful Functions Playground☆131Updated last year
- Uniffle is a high performance, general purpose Remote Shuffle Service.☆401Updated this week
- Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).☆17Updated 3 weeks ago
- An Extensible Data Skipping Framework☆43Updated last month
- Benchmarks for Apache Flink☆173Updated this week
- ☆55Updated this week
- The Internals of Delta Lake☆183Updated last month