antgroup / ant-ray
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads. AntRay is forked from ray, offering incremental new features on top of the community version.
☆122Updated this week
Alternatives and similar repositories for ant-ray:
Users that are interested in ant-ray are comparing it to the libraries listed below
- ☆209Updated last year
- Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.☆97Updated 10 months ago
- KV cache store for distributed LLM inference☆171Updated last week
- Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.☆267Updated 2 years ago
- TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.☆94Updated 2 years ago
- alibabacloud-jindodata☆188Updated last week
- vsag is a vector indexing library used for similarity search.☆258Updated this week
- Tracking Ray Enhancement Proposals☆53Updated last month
- GLake: optimizing GPU memory management and IO transmission.☆457Updated last month
- Efficient and easy multi-instance LLM serving☆402Updated this week
- Run your deep learning workloads on Kubernetes more easily and efficiently.☆521Updated last year
- The driver for LMCache core to run in vLLM☆39Updated 3 months ago
- Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.☆255Updated 11 months ago
- RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.☆333Updated 2 weeks ago
- Lightning In-Memory Object Store☆45Updated 3 years ago
- Kubernetes Operator for AI and Bigdata Elastic Training☆85Updated 4 months ago
- GPU-scheduler-for-deep-learning☆205Updated 4 years ago
- OpenEmbedding is an open source framework for Tensorflow distributed training acceleration.☆31Updated 2 years ago
- Kubernetes Scheduler for Deep Learning☆262Updated 2 years ago
- Pafka is originated from the OpenAIOS project to leverage an optimized tiered storage access strategy to improve overall performance for …☆67Updated 3 years ago
- A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster☆157Updated last year
- Automatic tuning for ML model deployment on Kubernetes☆80Updated 6 months ago
- ☆58Updated 4 years ago
- The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes☆44Updated 3 years ago
- A modular acceleration toolkit for big data analytic engines☆68Updated last year
- High performance RDMA-based distributed feature collection component for training GNN model on EXTREMELY large graph☆52Updated 2 years ago
- OpenAIOS is an incubating open-source distributed OS kernel based on Kubernetes for AI workloads. OpenAIOS-Platform is an AI development…☆97Updated 3 years ago
- A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod☆125Updated 3 years ago
- Fault-tolerant for DL frameworks☆70Updated last year
- Elastic Deep Learning Training based on Kubernetes by Leveraging EDL and Volcano☆32Updated last year