apache / spark-kubernetes-operator

Related projects ⓘ

Alternatives and complementary repositories for spark-kubernetes-operator

• apache / iceberg-docs
  Apache Iceberg Documentation Site
  ☆42Updated 9 months ago
• IBM / spark-s3-shuffle
  A S3 Shuffle plugin for Apache Spark to enable elastic scaling for generic Spark workloads.
  ☆38Updated 6 months ago
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆61Updated this week
• apple / batch-processing-gateway
  The gateway component to make Spark on K8s much easier for Spark users.
  ☆181Updated 4 months ago
• trinodb / benchto
  Framework for running macro benchmarks in a clustered environment
  ☆31Updated this week
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆85Updated 7 months ago
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆111Updated this week
• apache / paimon-trino
  Trino Connector for Apache Paimon.
  ☆27Updated this week
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆70Updated 2 years ago
• trinodb / charts
  ☆151Updated this week
• trinodb / trino-gateway
  ☆163Updated this week
• AbsaOSS / spline-spark-agent
  Spline agent for Apache Spark
  ☆185Updated 2 weeks ago
• xskipper-io / xskipper
  An Extensible Data Skipping Framework
  ☆42Updated last year
• aws-samples / eks-spark-benchmark
  Performance optimization for Spark running on Kubernetes
  ☆85Updated 4 years ago
• CoxAutomotiveDataSolutions / spark-distcp
  A re-implementation of Hadoop DistCP in Apache Spark
  ☆44Updated 11 months ago
• cloudcheflabs / dataroaster
  ☆40Updated last year
• onehouseinc / LakeView
  Monitoring and insights on your data lakehouse tables
  ☆22Updated this week
• uber / RemoteShuffleService
  Remote shuffle service for Apache Spark to store shuffle data on remote servers.
  ☆323Updated last year
• datapunchorg / punch
  This project provides fully automated one-click experience to create Cloud and Kubernetes environment to run Data Analytics workload like…
  ☆53Updated last year
• exacaster / lighter
  REST API for Apache Spark on K8S or YARN
  ☆92Updated this week
• spotify / flink-on-k8s-operator
  Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.
  ☆195Updated 2 months ago
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆182Updated last month
• aws-samples / emr-remote-shuffle-service
  ☆12Updated 2 weeks ago
• getindata / kafka-connect-iceberg-sink
  ☆78Updated last year
• maropu / spark-tpcds-datagen
  All the things about TPC-DS in Apache Spark
  ☆104Updated last year
• voltrondata / spark-substrait-gateway
  Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
  ☆16Updated last month
• awesome-kyuubi / hadoop-testing
  Testing Sandbox for Hadoop Ecosystem Components
  ☆32Updated this week