Alternatives and similar repositories for awesome-ray

Users that are interested in awesome-ray are comparing it to the libraries listed below

• maxpumperla / learning_ray
  Notebooks for the O'Reilly book "Learning Ray"
  ☆341Updated last year
• ray-project / ray-educational-materials
  This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.
  ☆451Updated last year
• AdrianBZG / LLM-distributed-finetune
  Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the …
  ☆60Updated 2 years ago
• ray-project / enhancements
  Tracking Ray Enhancement Proposals
  ☆61Updated 2 weeks ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆131Updated 3 months ago
• triton-inference-server / fil_backend
  FIL backend for the Triton Inference Server
  ☆87Updated 3 weeks ago
• ray-project / raydp
  RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.
  ☆356Updated last week
• ray-project / xgboost_ray
  Distributed XGBoost on Ray
  ☆152Updated last year
• meta-pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆162Updated last week
• bentoml / llm-bench
  ☆56Updated last year
• ray-project / ray_beam_runner
  Ray-based Apache Beam runner
  ☆42Updated 2 years ago
• meta-pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆408Updated last week
• google / space
  Unified storage framework for the entire machine learning lifecycle
  ☆155Updated last year
• scalingpythonml / scaling-python-with-ray
  Serverless Python with Ray
  ☆59Updated 3 years ago
• dmatrix / ray-core-tutorial
  Introduction to Ray Core Design Patterns and APIs.
  ☆74Updated last year
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆168Updated last week
• sgl-project / genai-bench
  Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…
  ☆250Updated 3 weeks ago
• anyscale / llm-continuous-batching-benchmarks
  ☆122Updated last year
• imbue-ai / cluster-health
  ☆318Updated last year
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆114Updated 2 years ago
• petuum / adaptdl
  Resource-adaptive cluster scheduler for deep learning training.
  ☆450Updated 2 years ago
• ray-project / mobius
  Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.
  ☆99Updated last year
• meta-pytorch / torchft
  Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)
  ☆462Updated last week
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆64Updated last year
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆215Updated 8 months ago
• gpuopenanalytics / pynvml
  Provide Python access to the NVML library for GPU diagnostics
  ☆253Updated 3 months ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆82Updated 10 months ago
• run-ai / llmperf
  ☆60Updated last year
• NVIDIA / spark-rapids-examples
  A repo for all spark examples using Rapids Accelerator including ETL, ML/DL, etc.
  ☆164Updated last week
• triton-inference-server / perf_analyzer
  ☆128Updated 2 weeks ago