antgroup / ant-rayLinks
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads. AntRay is forked from ray, offering incremental new features on top of the community version.
☆126Updated this week
Alternatives and similar repositories for ant-ray
Users that are interested in ant-ray are comparing it to the libraries listed below
Sorting:
- Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.☆97Updated 11 months ago
- vsag is a vector indexing library used for similarity search.☆291Updated this week
- KV cache store for distributed LLM inference☆250Updated this week
- RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.☆337Updated last month
- ☆210Updated last year
- TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.☆94Updated 2 years ago
- Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.☆267Updated 2 years ago
- Pafka is originated from the OpenAIOS project to leverage an optimized tiered storage access strategy to improve overall performance for …☆67Updated 3 years ago
- alibabacloud-jindodata☆190Updated last week
- Tracking Ray Enhancement Proposals☆54Updated last month
- GLake: optimizing GPU memory management and IO transmission.☆463Updated 2 months ago
- A modular acceleration toolkit for big data analytic engines☆68Updated last year
- Knowhere is an open-source vector search engine, integrating FAISS, HNSW, etc.☆210Updated last year
- OpenEmbedding is an open source framework for Tensorflow distributed training acceleration.☆32Updated 2 years ago
- The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes☆44Updated 3 years ago
- Vector search engine inside Milvus, integrating FAISS, HNSW, DiskANN.☆239Updated this week
- Efficient and easy multi-instance LLM serving☆420Updated this week
- The driver for LMCache core to run in vLLM☆41Updated 3 months ago
- ☆25Updated 2 months ago
- Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.☆256Updated last year
- PyTorch distributed training acceleration framework☆49Updated 3 months ago
- A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.☆80Updated 2 weeks ago
- MSVBASE is a system that efficiently supports complex queries of both approximate similarity search and relational operators. It integrat…☆93Updated 6 months ago
- Run your deep learning workloads on Kubernetes more easily and efficiently.☆522Updated last year
- PilotScope is a middleware to bridge the gaps of deploying AI4DB (Artificial Intelligence for Databases) algorithms into actual database …☆160Updated 7 months ago
- FireFlyer Record file format, writer and reader for DL training samples.☆224Updated 2 years ago
- ☆122Updated 3 months ago
- Automatic tuning for ML model deployment on Kubernetes☆80Updated 7 months ago
- libhdfs3 a native c/c++ hdfs client☆47Updated 10 months ago
- continuously update cloud database papers☆79Updated last year