Alternatives and similar repositories for spark

Users that are interested in spark are comparing it to the libraries listed below

• aliyun / alibabacloud-jindodata
  alibabacloud-jindodata
  ☆202Updated 2 weeks ago
• prestodb / presto-kubernetes-operator
  ☆37Updated 3 years ago
• tkestack / yarn-opterator
  An kubernetes opterator to manager the yarn nodemanager, which can be used to deploy yarn on kubernetes.
  ☆22Updated 5 years ago
• kubedl-io / kubedl
  Run your deep learning workloads on Kubernetes more easily and efficiently.
  ☆532Updated last year
• palantir / k8s-spark-scheduler
  A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes
  ☆177Updated 2 years ago
• AliyunContainerService / arena
  A CLI for Kubeflow.
  ☆60Updated 2 years ago
• tkestack / flink-on-k8s-operator
  Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.
  ☆32Updated 5 years ago
• alauda / kubeflow-chart
  Kubeflow helm chart
  ☆144Updated 2 years ago
• kleveross / klever
  Cloud Native ML/DL Platform
  ☆133Updated 5 years ago
• Tencent / Firestorm
  Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shu…
  ☆257Updated 2 years ago
• volcano-sh / apis
  The API (CRD) of Volcano
  ☆49Updated last week
• AliyunContainerService / benchmark-for-spark
  benchmark-for-spark
  ☆18Updated 9 months ago
• volcano-sh / devices
  Device plugins for Volcano, e.g. GPU
  ☆132Updated 10 months ago
• pokerfaceSad / GPUMounter
  A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod
  ☆127Updated 3 years ago
• Tencent / caelus
  Set of Kubernetes solutions for reusing idle resources of nodes by running extra batch jobs
  ☆357Updated 7 months ago
• Alluxio / k8s-operator
  An operator for managing Alluxio system on Kubernetes cluster
  ☆13Updated 2 years ago
• yilong2001 / spark-sql-on-k8s
  最简单的 spark sql on kubernetes 生产环境部署方案
  ☆19Updated 2 years ago
• apache / yunikorn-core
  Apache YuniKorn Core
  ☆1,000Updated this week
• kyligence-xuanwu / document
  ☆19Updated 2 years ago
• kubeflow / common
  Common APIs and libraries shared by other Kubeflow operator repositories.
  ☆53Updated 2 years ago
• AliyunContainerService / et-operator
  Kubernetes Operator for AI and Bigdata Elastic Training
  ☆90Updated last year
• StarRocks / starrocks-kubernetes-operator
  Kubernetes Operator for StarRocks
  ☆183Updated 2 weeks ago
• cubefs / shuttle
  Shuttle：High Available, High Performance Remote Shuffle Service
  ☆157Updated 2 years ago
• kubeflow / arena
  A CLI for Kubeflow.
  ☆810Updated last week
• tkestack / gpu-admission
  ☆132Updated 4 years ago
• bytedance / CloudShuffleService
  Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.
  ☆262Updated last year
• AliyunContainerService / gpushare-device-plugin
  GPU Sharing Device Plugin for Kubernetes Cluster
  ☆492Updated 3 years ago
• tencentyun / hadoop-cos
  hadoop-cos（CosN文件系统）为Apache Hadoop、Spark以及Tez等大数据计算框架集成提供支持，可以像访问HDFS一样读写存储在腾讯云COS上的数据。同时也支持作为Druid等查询与分析引擎的Deep Storage
  ☆93Updated last month
• chenseanxy / helm-hadoop-3
  Helm chart from stable/hadoop, updated to hadoop 3.2.1
  ☆23Updated 6 years ago
• PaddleFlow / paddle-operator
  Elastic Deep Learning Training based on Kubernetes by Leveraging EDL and Volcano
  ☆32Updated 2 years ago