Alternatives and similar repositories for ant-ray

Users that are interested in ant-ray are comparing it to the libraries listed below

• bytedance / primus
  ☆222Updated 2 years ago
• bytedance / InfiniStore
  KV cache store for distributed LLM inference
  ☆387Updated 2 months ago
• ray-project / mobius
  Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.
  ☆99Updated last year
• ray-project / Ray-Forward
  Some resources about Ray Forward Meetup
  ☆30Updated last month
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆99Updated 2 years ago
• antgroup / vsag
  vsag is a vector indexing library used for similarity search.
  ☆449Updated this week
• AlibabaPAI / llumnix
  Efficient and easy multi-instance LLM serving
  ☆523Updated 4 months ago
• antgroup / glake
  GLake: optimizing GPU memory management and IO transmission.
  ☆497Updated 10 months ago
• inclusionAI / asystem-awex
  A high-performance RL training-inference weight synchronization framework, designed to enable second-level parameter updates from trainin…
  ☆129Updated last month
• ray-project / enhancements
  Tracking Ray Enhancement Proposals
  ☆63Updated last month
• baidu / puck
  Puck is a high-performance ANN search engine
  ☆367Updated 8 months ago
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆271Updated 2 years ago
• sgl-project / ome
  Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…
  ☆360Updated last week
• sgl-project / rbg
  A workload for deploying LLM inference services on Kubernetes
  ☆160Updated last week
• kubedl-io / kubedl
  Run your deep learning workloads on Kubernetes more easily and efficiently.
  ☆532Updated last year
• aliyun / alibabacloud-jindodata
  alibabacloud-jindodata
  ☆202Updated last week
• milvus-io / knowhere
  Knowhere is an open-source vector search engine, integrating FAISS, HNSW, etc.
  ☆219Updated 2 years ago
• ray-project / raydp
  RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.
  ☆360Updated last month
• kubedl-io / morphling
  Automatic tuning for ML model deployment on Kubernetes
  ☆81Updated last year
• zilliztech / knowhere
  Vector search engine inside Milvus, integrating FAISS, HNSW, DiskANN.
  ☆319Updated this week
• ovg-project / kvcached
  Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
  ☆760Updated 2 weeks ago
• microsoft / hivedscheduler
  Kubernetes Scheduler for Deep Learning
  ☆262Updated 3 years ago
• DeepRec-AI / HybridBackend
  A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster
  ☆160Updated last year
• Qihoo360 / dgl-operator
  The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes
  ☆44Updated 4 years ago
• HFAiLab / ffrecord
  FireFlyer Record file format, writer and reader for DL training samples.
  ☆238Updated 3 years ago
• 4paradigm / OpenEmbedding
  OpenEmbedding is an open source framework for Tensorflow distributed training acceleration.
  ☆33Updated 2 years ago
• alibaba / GPU-scheduler-for-deep-learning
  GPU-scheduler-for-deep-learning
  ☆210Updated 5 years ago
• eosphoros-ai / liteio
  LiteIO is a cloud-native block device service that uses multiple storage engines, including SPDK and LVM, to achieve high performance. It…
  ☆319Updated last year
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆60Updated 11 months ago
• kleveross / ftlib
  Fault-tolerant for DL frameworks
  ☆70Updated 2 years ago