apache / spark-kubernetes-operator

Related projects: ⓘ

• trinodb / benchto
  Framework for running macro benchmarks in a clustered environment
  ☆28Updated 3 months ago
• trinodb / charts
  ☆143Updated last week
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆71Updated 2 years ago
• apache / iceberg-docs
  Apache Iceberg Documentation Site
  ☆42Updated 7 months ago
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆51Updated this week
• cloudcheflabs / dataroaster
  ☆40Updated last year
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆111Updated last month
• IBM / spark-s3-shuffle
  A S3 Shuffle plugin for Apache Spark to enable elastic scaling for generic Spark workloads.
  ☆37Updated 4 months ago
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆82Updated 5 months ago
• aws-samples / eks-spark-benchmark
  Performance optimization for Spark running on Kubernetes
  ☆84Updated 4 years ago
• databricks / tpcds-kit
  TPC-DS benchmark kit with some modifications/fixes
  ☆85Updated last month
• spotify / flink-on-k8s-operator
  Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.
  ☆188Updated 3 weeks ago
• aws-samples / emr-remote-shuffle-service
  ☆12Updated 3 months ago
• immerok / recipes
  ☆129Updated this week
• apache / paimon-trino
  Trino Connector for Apache Paimon.
  ☆25Updated 2 weeks ago
• xskipper-io / xskipper
  An Extensible Data Skipping Framework
  ☆42Updated last year
• CoxAutomotiveDataSolutions / spark-distcp
  A re-implementation of Hadoop DistCP in Apache Spark
  ☆42Updated 8 months ago
• awesome-kyuubi / hadoop-testing
  Testing Sandbox for Hadoop Ecosystem Components
  ☆32Updated last month
• Wh1isper / sparglim
  Sparglim✨ makes PySpark App Configurable and Deploy Spark Connect Server Easier!
  ☆35Updated last month
• datapunchorg / punch
  This project provides fully automated one-click experience to create Cloud and Kubernetes environment to run Data Analytics workload like…
  ☆52Updated last year
• tabular-io / iceberg-rest-image
  Simple project to expose a catalog over REST using a Java catalog backend
  ☆103Updated this week
• snowlift / trino-storage
  Storage connector for Trino
  ☆90Updated 2 weeks ago
• apple / batch-processing-gateway
  The gateway component to make Spark on K8s much easier for Spark users.
  ☆178Updated 2 months ago
• varadaio / presto-workload-analyzer
  The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them
  ☆135Updated 10 months ago
• trinodb / trino-gateway
  ☆144Updated this week
• maropu / spark-tpcds-datagen
  All the things about TPC-DS in Apache Spark
  ☆104Updated last year
• apache / flink-connector-pulsar
  Apache flink
  ☆45Updated this week
• datapunchorg / spark-ui-reverse-proxy
  This project provides a reverse proxy for Spark UI on Kubernetes
  ☆14Updated 11 months ago
• getindata / kafka-connect-iceberg-sink
  ☆77Updated last year
• tabular-io / iceberg-kafka-connect
  ☆197Updated last month