Alternatives and similar repositories for ant-ray

Users that are interested in ant-ray are comparing it to the libraries listed below

• ray-project / mobius
  Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.
  ☆97Updated last year
• bytedance / primus
  ☆210Updated 2 years ago
• bytedance / InfiniStore
  KV cache store for distributed LLM inference
  ☆269Updated 2 weeks ago
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆267Updated 2 years ago
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆94Updated 2 years ago
• ray-project / enhancements
  Tracking Ray Enhancement Proposals
  ☆53Updated 2 months ago
• AlibabaPAI / llumnix
  Efficient and easy multi-instance LLM serving
  ☆437Updated this week
• DeepRec-AI / HybridBackend
  A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster
  ☆158Updated last year
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆42Updated 4 months ago
• NVIDIA-Merlin / HierarchicalKV
  HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of…
  ☆152Updated this week
• kubedl-io / kubedl
  Run your deep learning workloads on Kubernetes more easily and efficiently.
  ☆524Updated last year
• AlibabaPAI / torchacc
  PyTorch distributed training acceleration framework
  ☆49Updated 4 months ago
• oap-project / raydp
  RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.
  ☆339Updated 2 months ago
• PaddlePaddle / PaddleFlow
  ☆122Updated 4 months ago
• antgroup / glake
  GLake: optimizing GPU memory management and IO transmission.
  ☆467Updated 3 months ago
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆87Updated last month
• alibaba / GPU-scheduler-for-deep-learning
  GPU-scheduler-for-deep-learning
  ☆206Updated 4 years ago
• AliyunContainerService / et-operator
  Kubernetes Operator for AI and Bigdata Elastic Training
  ☆87Updated 5 months ago
• zw0610 / zw0610.github.io
  ☆58Updated 4 years ago
• pokerfaceSad / GPUMounter
  A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod
  ☆125Updated 3 years ago
• ai-dynamo / nixl
  NVIDIA Inference Xfer Library (NIXL)
  ☆422Updated this week
• volcengine / ml-platform-sdk-python
  ☆31Updated 2 years ago
• kleveross / ftlib
  Fault-tolerant for DL frameworks
  ☆70Updated last year
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆129Updated last month
• aliyun / alibabacloud-jindodata
  alibabacloud-jindodata
  ☆194Updated 3 weeks ago
• triton-inference-server / triton_distributed
  ☆50Updated 3 months ago
• baidu / puck
  Puck is a high-performance ANN search engine
  ☆359Updated 3 weeks ago
• bytedance-iaas / splitwise-demos
  ☆26Updated 3 months ago
• kubedl-io / morphling
  Automatic tuning for ML model deployment on Kubernetes
  ☆80Updated 7 months ago
• antgroup / vsag
  vsag is a vector indexing library used for similarity search.
  ☆316Updated this week