Alternatives and similar repositories for sunray

Users that are interested in sunray are comparing it to the libraries listed below

• simon-mo / vLLM-Benchmark
  ☆29Updated 3 months ago
• danyangz / lightning
  Lightning In-Memory Object Store
  ☆47Updated 3 years ago
• ray-project / plasma
  A minimal shared memory object store design
  ☆53Updated 8 years ago
• SJTU-IPADS / vegito
  ☆53Updated 2 years ago
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆45Updated 5 months ago
• ray-project / enhancements
  Tracking Ray Enhancement Proposals
  ☆53Updated 3 months ago
• sgl-project / genai-bench
  Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…
  ☆172Updated last week
• bytedance / InfiniStore
  KV cache store for distributed LLM inference
  ☆290Updated last month
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆18Updated 2 years ago
• rapidsai / ucx-py
  Python bindings for UCX
  ☆137Updated this week
• google / nccl-fastsocket
  NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
  ☆118Updated last year
• fsspec / opendalfs
  OpenDAL fsspec integration
  ☆30Updated last month
• marsupialtail / rottnest
  Data lake indices
  ☆40Updated this week
• little-squirrel-cute / most
  Codes for MO's Trading
  ☆15Updated 3 years ago
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆113Updated 2 years ago
• microsoft / dist-ir
  An IR for efficiently simulating distributed ML computation.
  ☆29Updated last year
• SJTU-IPADS / PhoenixOS
  Fast OS-level support for GPU checkpoint and restore
  ☆218Updated last week
• facebookresearch / param
  PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…
  ☆147Updated 3 weeks ago
• octoml / synr
  A library for syntactically rewriting Python programs, pronounced (sinner).
  ☆69Updated 3 years ago
• foundation-model-stack / fastsafetensors
  High-performance safetensors model loader
  ☆50Updated this week
• facebookincubator / dynolog
  Dynolog is a telemetry daemon for performance monitoring and tracing. It exports metrics from different components in the system like the…
  ☆325Updated this week
• ldbc / ldbc_snb_bi
  Reference implementations for the LDBC Social Network Benchmark's Business Intelligence (BI) workload
  ☆43Updated 3 months ago
• Vexless / Vexless
  A code base for Vexless
  ☆16Updated last year
• ai-dynamo / nixl
  NVIDIA Inference Xfer Library (NIXL)
  ☆484Updated this week
• awslabs / lorien
  ☆43Updated last year
• Azure / msccl
  Microsoft Collective Communication Library
  ☆63Updated 8 months ago
• intel / ScalableVectorSearch
  ☆174Updated this week
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆348Updated 5 months ago
• lingo-db / lingo-db
  LingoDB: A new analytical database system that blurs the lines between databases and compilers.
  ☆267Updated this week
• sjtu-sail / seminar
  The schedule of the seminar
  ☆25Updated 3 years ago