Alternatives and similar repositories for spark

Users that are interested in spark are comparing it to the libraries listed below

• aliyun / alibabacloud-jindodata
  alibabacloud-jindodata
  ☆202Updated this week
• tkestack / yarn-opterator
  An kubernetes opterator to manager the yarn nodemanager, which can be used to deploy yarn on kubernetes.
  ☆22Updated 5 years ago
• palantir / k8s-spark-scheduler
  A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes
  ☆176Updated 2 years ago
• tkestack / flink-on-k8s-operator
  Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.
  ☆32Updated 5 years ago
• AliyunContainerService / benchmark-for-spark
  benchmark-for-spark
  ☆17Updated 8 months ago
• volcano-sh / apis
  The API (CRD) of Volcano
  ☆49Updated 2 weeks ago
• Alluxio / k8s-operator
  An operator for managing Alluxio system on Kubernetes cluster
  ☆13Updated 2 years ago
• kleveross / klever
  Cloud Native ML/DL Platform
  ☆133Updated 5 years ago
• alauda / kubeflow-chart
  Kubeflow helm chart
  ☆144Updated 2 years ago
• Tencent / caelus
  Set of Kubernetes solutions for reusing idle resources of nodes by running extra batch jobs
  ☆356Updated 6 months ago
• Tencent / Firestorm
  Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shu…
  ☆257Updated 2 years ago
• kubedl-io / kubedl
  Run your deep learning workloads on Kubernetes more easily and efficiently.
  ☆532Updated last year
• xingtanzjr / hadoop-on-kubernetes
  hadoop on kubernetes. It contains the configuration of HDFS and Yarn
  ☆30Updated 7 years ago
• yilong2001 / spark-sql-on-k8s
  最简单的 spark sql on kubernetes 生产环境部署方案
  ☆19Updated 2 years ago
• volcano-sh / devices
  Device plugins for Volcano, e.g. GPU
  ☆131Updated 10 months ago
• AliyunContainerService / arena
  A CLI for Kubeflow.
  ☆60Updated 2 years ago
• apache / yunikorn-core
  Apache YuniKorn Core
  ☆996Updated last week
• skai-x / elastic-jupyter-operator
  Cloud-native way to provide elastic Jupyter Notebooks on Kubernetes. Run remote kernels, natively.
  ☆204Updated 3 years ago
• kubeflow / common
  Common APIs and libraries shared by other Kubeflow operator repositories.
  ☆53Updated 2 years ago
• AliyunContainerService / et-operator
  Kubernetes Operator for AI and Bigdata Elastic Training
  ☆90Updated last year
• opendataio / hcfsfuse
  A hadoop compatible FUSE use for all.
  ☆29Updated last year
• kyligence-xuanwu / document
  ☆19Updated 2 years ago
• bytedance / CloudShuffleService
  Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.
  ☆262Updated last year
• tencentyun / hadoop-cos
  hadoop-cos（CosN文件系统）为Apache Hadoop、Spark以及Tez等大数据计算框架集成提供支持，可以像访问HDFS一样读写存储在腾讯云COS上的数据。同时也支持作为Druid等查询与分析引擎的Deep Storage
  ☆93Updated 3 weeks ago
• kubeflow / arena
  A CLI for Kubeflow.
  ☆809Updated last week
• kubeflow / mpi-operator
  Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)
  ☆506Updated last week
• StarRocks / starrocks-kubernetes-operator
  Kubernetes Operator for StarRocks
  ☆182Updated 2 months ago
• GoogleCloudPlatform / flink-on-k8s-operator
  [DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.
  ☆657Updated 3 years ago
• prestodb / presto-kubernetes-operator
  ☆37Updated 3 years ago
• cubefs / shuttle
  Shuttle：High Available, High Performance Remote Shuffle Service
  ☆157Updated 2 years ago