JiahaoYao / awesome-rayLinks
Ray - A curated list of resources: https://github.com/ray-project/ray
☆71Updated 2 weeks ago
Alternatives and similar repositories for awesome-ray
Users that are interested in awesome-ray are comparing it to the libraries listed below
Sorting:
- Notebooks for the O'Reilly book "Learning Ray"☆331Updated last year
 - This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.☆435Updated last year
 - Pretrain, finetune and serve LLMs on Intel platforms with Ray☆132Updated last month
 - Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the …☆59Updated 2 years ago
 - Tracking Ray Enhancement Proposals☆56Updated 6 months ago
 - RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.☆348Updated 3 months ago
 - Unified storage framework for the entire machine learning lifecycle☆155Updated last year
 - FIL backend for the Triton Inference Server☆83Updated 3 weeks ago
 - TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆398Updated this week
 - A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆161Updated last month
 - Distributed XGBoost on Ray☆151Updated last year
 - ☆121Updated last year
 - Ray-based Apache Beam runner☆41Updated 2 years ago
 - ☆31Updated 3 years ago
 - ☆56Updated 11 months ago
 - Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…☆225Updated last week
 - ArcticInference: vLLM plugin for high-throughput, low-latency inference☆288Updated last week
 - ☆24Updated this week
 - A repo for all spark examples using Rapids Accelerator including ETL, ML/DL, etc.☆165Updated this week
 - The Triton backend for the PyTorch TorchScript models.☆163Updated this week
 - Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.☆100Updated last year
 - ☆58Updated last year
 - LLM Serving Performance Evaluation Harness☆80Updated 8 months ago
 - WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Updated 3 years ago
 - Pytorch DTensor native training library for LLMs/VLMs with OOTB Hugging Face support☆141Updated this week
 - ☆316Updated last year
 - Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆213Updated 6 months ago
 - Common recipes to run vLLM☆196Updated this week
 - 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆216Updated this week
 - ☆304Updated this week