Alternatives and similar repositories for vllm-spyre

Users that are interested in vllm-spyre are comparing it to the libraries listed below

• llm-d / llm-d-benchmark
  llm-d benchmark scripts and tooling
  ☆18Updated this week
• IBM / autopilot
  A tool to detect infrastructure issues on cloud native AI systems
  ☆42Updated last month
• HabanaAI / hccl_demo
  ☆22Updated 2 months ago
• fmperf-project / fmperf
  Cloud Native Benchmarking of Foundation Models
  ☆38Updated last month
• caikit / caikit-nlp
  ☆12Updated 2 weeks ago
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆77Updated this week
• openshift-psap / llm-load-test
  ☆45Updated 4 months ago
• ROCm / aws-ofi-rccl
  ☆16Updated 3 months ago
• OSU-Nowlab / Flover
  A novel temporal fusion framework for propelling autoregressive model inference
  ☆11Updated this week
• NVIDIA / MagnumIO
  Magnum IO community repo
  ☆95Updated 2 months ago
• intel / torch-xpu-ops
  ☆48Updated this week
• merthidayetoglu / HiCCL
  A hierarchical collective communications library with portable optimizations
  ☆35Updated 7 months ago
• ROCm / rocSHMEM
  rocSHMEM intra-kernel networking runtime for AMD dGPUs on the ROCm platform.
  ☆91Updated this week
• LMCache / LMBenchmark
  Systematic and comprehensive benchmarks for LLM systems.
  ☆19Updated 2 weeks ago
• mlcommons / hpc
  Reference implementations of MLPerf™ HPC training benchmarks
  ☆48Updated 4 months ago
• astra-sim / tacos
  TACOS: [T]opology-[A]ware [Co]llective Algorithm [S]ynthesizer for Distributed Machine Learning
  ☆25Updated last month
• KernelTuner / kernel_launcher
  Using C++ magic to launch/capture CUDA kernels and tune them with Kernel Tuner
  ☆20Updated last year
• ROCm / rocm_bandwidth_test
  Bandwidth test for ROCm
  ☆60Updated this week
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆61Updated 2 weeks ago
• astra-sim / symbolic_tensor_graph
  ☆18Updated last month
• azrael417 / mlperf-deepcam
  This is the public repo for the MLPerf DeepCAM climate data segmentation proposal.
  ☆16Updated 3 years ago
• ROCm / Megatron-LM
  Ongoing research training transformer models at scale
  ☆25Updated last week
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆34Updated 3 months ago
• uxlfoundation / foundation
  ☆86Updated last week
• ROCm / rdc
  RDC
  ☆30Updated this week
• microsoft / superbenchmark
  A validation and profiling tool for AI infrastructure
  ☆321Updated last week
• opea-project / docs
  This repo contains documents of the OPEA project
  ☆42Updated last week
• NVIDIA / cloudai
  CloudAI Benchmark Framework
  ☆68Updated this week
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆97Updated 3 weeks ago
• HabanaAI / Gaudi-tutorials
  Tutorials for running models on First-gen Gaudi and Gaudi2 for Training and Inference. The source files for the tutorials on https://dev…
  ☆62Updated 3 weeks ago