Alternatives and similar repositories for spark-on-k8s

Users that are interested in spark-on-k8s are comparing it to the libraries listed below

• aws-samples / eks-spark-benchmark
  Performance optimization for Spark running on Kubernetes
  ☆89Updated 4 years ago
• JahstreetOrg / spark-on-kubernetes-docker
  Spark on Kubernetes infrastructure Docker images repo
  ☆37Updated 2 years ago
• JahstreetOrg / spark-on-kubernetes-helm
  Spark on Kubernetes infrastructure Helm charts repo
  ☆203Updated 2 years ago
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆89Updated last month
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆125Updated last month
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆99Updated 2 years ago
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆71Updated 3 years ago
• cloudcheflabs / dataroaster
  ☆40Updated 2 years ago
• SaurabhChawla100 / spark-radiant
  Spark-Radiant is Apache Spark Performance and Cost Optimizer
  ☆25Updated 5 months ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• qubole / spark-state-store
  Rocksdb state storage implementation for Structured Streaming.
  ☆17Updated 4 years ago
• joshuarobinson / trino-on-k8s
  Setup for running Trino with Hive Metastore on Kubernetes
  ☆101Updated 2 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆59Updated last year
• getindata / kafka-connect-iceberg-sink
  ☆80Updated 2 months ago
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 4 years ago
• TIBCOSoftware / snappy-on-k8s
  An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes
  ☆83Updated 5 years ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆226Updated 3 months ago
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆79Updated 2 months ago
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆35Updated 8 months ago
• open-datastudio / spark-serverless
  Instant access to the Spark cluster from anywhere
  ☆16Updated 4 years ago
• exacaster / lighter
  REST API for Apache Spark on K8S or YARN
  ☆98Updated 2 weeks ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• minio / spark-select
  A library for Spark DataFrame using MinIO Select API
  ☆98Updated 5 years ago
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆124Updated last week
• AbsaOSS / spline-getting-started
  ☆24Updated 9 months ago
• maropu / spark-sql-server
  Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol
  ☆34Updated 2 years ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆105Updated 9 months ago
• nielsbasjes / splittablegzip
  Splittable Gzip codec for Hadoop
  ☆70Updated last month
• 10xfuturetechnologies / kafka-connect-iceberg
  Kafka Connector for Iceberg tables
  ☆16Updated last year
• TomLous / medium-spark-k8s
  Spark on Kubernetes using Helm
  ☆34Updated 5 years ago