Alternatives and similar repositories for spark

Users that are interested in spark are comparing it to the libraries listed below

• tkestack / yarn-opterator
  An kubernetes opterator to manager the yarn nodemanager, which can be used to deploy yarn on kubernetes.
  ☆22Updated 4 years ago
• aliyun / alibabacloud-jindodata
  alibabacloud-jindodata
  ☆199Updated 3 weeks ago
• prestodb / presto-kubernetes-operator
  ☆37Updated 2 years ago
• yilong2001 / spark-sql-on-k8s
  最简单的 spark sql on kubernetes 生产环境部署方案
  ☆18Updated 2 years ago
• palantir / k8s-spark-scheduler
  A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes
  ☆176Updated 2 years ago
• Tencent / caelus
  Set of Kubernetes solutions for reusing idle resources of nodes by running extra batch jobs
  ☆356Updated 3 months ago
• alauda / kubeflow-chart
  Kubeflow helm chart
  ☆144Updated 2 years ago
• tkestack / flink-on-k8s-operator
  Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.
  ☆32Updated 5 years ago
• kubedl-io / kubedl
  Run your deep learning workloads on Kubernetes more easily and efficiently.
  ☆532Updated last year
• AliyunContainerService / arena
  A CLI for Kubeflow.
  ☆60Updated last year
• volcano-sh / apis
  The API (CRD) of Volcano
  ☆45Updated this week
• kleveross / klever
  Cloud Native ML/DL Platform
  ☆133Updated 5 years ago
• Tencent / Firestorm
  Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shu…
  ☆257Updated 2 years ago
• Alluxio / k8s-operator
  An operator for managing Alluxio system on Kubernetes cluster
  ☆13Updated last year
• bytedance / CloudShuffleService
  Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.
  ☆261Updated last year
• kubeflow / arena
  A CLI for Kubeflow.
  ☆798Updated last month
• cubefs / shuttle
  Shuttle：High Available, High Performance Remote Shuffle Service
  ☆156Updated 2 years ago
• AliyunContainerService / et-operator
  Kubernetes Operator for AI and Bigdata Elastic Training
  ☆89Updated 9 months ago
• lyft / flinkk8soperator
  Kubernetes operator that provides control plane for managing Apache Flink applications
  ☆580Updated 2 months ago
• apache / yunikorn-k8shim
  Apache YuniKorn K8shim
  ☆160Updated last week
• volcano-sh / devices
  Device plugins for Volcano, e.g. GPU
  ☆129Updated 7 months ago
• GoogleCloudPlatform / flink-on-k8s-operator
  [DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.
  ☆658Updated 3 years ago
• apache / doris-operator
  Doris kubernetes operator
  ☆117Updated last month
• apache / yunikorn-core
  Apache YuniKorn Core
  ☆979Updated last week
• apache-spark-on-k8s / kubernetes-HDFS
  Repository holding configuration files for running an HDFS cluster in Kubernetes
  ☆398Updated last year
• xingtanzjr / hadoop-on-kubernetes
  hadoop on kubernetes. It contains the configuration of HDFS and Yarn
  ☆30Updated 7 years ago
• wangyang0918 / flink-native-k8s-operator
  Flink native Kubernetes Operator is a java based control plane for running Apache Flink native application on Kubernetes.
  ☆52Updated 3 years ago
• Project-HAMi / volcano-vgpu-device-plugin
  Device-plugin for volcano vgpu which support hard resource isolation
  ☆119Updated last month
• AliyunContainerService / benchmark-for-spark
  benchmark-for-spark
  ☆16Updated 5 months ago
• apache / dolphinscheduler-operator
  Apache DolphinScheduler Kubernetes Operator.
  ☆26Updated last year