Alternatives and similar repositories for awesome-ray

Users that are interested in awesome-ray are comparing it to the libraries listed below

• maxpumperla / learning_ray
  Notebooks for the O'Reilly book "Learning Ray"
  ☆329Updated last year
• ray-project / ray-educational-materials
  This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.
  ☆434Updated last year
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆131Updated 3 weeks ago
• AdrianBZG / LLM-distributed-finetune
  Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the …
  ☆59Updated 2 years ago
• ray-project / enhancements
  Tracking Ray Enhancement Proposals
  ☆55Updated 6 months ago
• google / space
  Unified storage framework for the entire machine learning lifecycle
  ☆155Updated last year
• triton-inference-server / fil_backend
  FIL backend for the Triton Inference Server
  ☆83Updated this week
• ray-project / distml
  Distributed ML Optimizer
  ☆34Updated 4 years ago
• ray-project / ray_beam_runner
  Ray-based Apache Beam runner
  ☆41Updated 2 years ago
• scalingpythonml / scaling-python-with-ray
  Serverless Python with Ray
  ☆58Updated 3 years ago
• bentoml / llm-bench
  ☆56Updated 10 months ago
• dmatrix / ray-core-tutorial
  Introduction to Ray Core Design Patterns and APIs.
  ☆72Updated last year
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆17Updated 3 years ago
• ray-project / xgboost_ray
  Distributed XGBoost on Ray
  ☆149Updated last year
• meta-pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆161Updated 3 weeks ago
• sgl-project / genai-bench
  Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…
  ☆219Updated last week
• meta-pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆394Updated this week
• skypilot-org / skypilot-catalog
  ☆24Updated last week
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆79Updated 7 months ago
• ray-project / mobius
  Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.
  ☆100Updated last year
• anyscale / llm-continuous-batching-benchmarks
  ☆121Updated last year
• imbue-ai / cluster-health
  ☆315Updated last year
• vllm-project / recipes
  Common recipes to run vLLM
  ☆154Updated last week
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆212Updated 5 months ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆83Updated last week
• snowflakedb / ArcticInference
  ArcticInference: vLLM plugin for high-throughput, low-latency inference
  ☆278Updated this week
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆114Updated 2 years ago
• meta-pytorch / torchft
  Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)
  ☆415Updated this week
• run-ai / llmperf
  ☆58Updated last year
• snowflakedb / ArcticTraining
  ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)
  ☆224Updated this week