Alternatives and similar repositories for vllm-spyre

Users that are interested in vllm-spyre are comparing it to the libraries listed below

• llm-d / llm-d-benchmark
  llm-d benchmark scripts and tooling
  ☆21Updated this week
• ROCm / aws-ofi-rccl
  ☆16Updated 4 months ago
• HabanaAI / hccl_demo
  ☆22Updated 2 weeks ago
• caikit / caikit-nlp
  ☆12Updated this week
• azrael417 / mlperf-deepcam
  This is the public repo for the MLPerf DeepCAM climate data segmentation proposal.
  ☆16Updated 3 years ago
• shixun404 / Fault-Tolerant-SGEMM-on-NVIDIA-GPUs
  Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs
  ☆12Updated 4 months ago
• intel / cutlass-sycl
  A CUTLASS implementation using SYCL
  ☆32Updated this week
• fmperf-project / fmperf
  Cloud Native Benchmarking of Foundation Models
  ☆39Updated last week
• mlcommons / hpc
  Reference implementations of MLPerf™ HPC training benchmarks
  ☆48Updated 5 months ago
• astra-sim / symbolic_tensor_graph
  ☆18Updated 2 months ago
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆78Updated this week
• IBM / autopilot
  A tool to detect infrastructure issues on cloud native AI systems
  ☆44Updated 2 weeks ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆61Updated last month
• ROCm / rdc
  RDC
  ☆29Updated this week
• HPCToolkit / hpctoolkit-tutorial-examples
  CPU and GPU tutorial examples
  ☆13Updated 4 months ago
• astra-sim / tacos
  TACOS: [T]opology-[A]ware [Co]llective Algorithm [S]ynthesizer for Distributed Machine Learning
  ☆25Updated last month
• intel / torch-xpu-ops
  ☆50Updated this week
• merthidayetoglu / HiCCL
  A hierarchical collective communications library with portable optimizations
  ☆36Updated 8 months ago
• hpdps-group / COCCL
  COCCL: Compression and precision co-aware collective communication library
  ☆24Updated 4 months ago
• openshift-psap / llm-load-test
  ☆47Updated last week
• st4sd / st4sd-runtime-core
  Create and deploy virtual-experiments - co-processing computational workflows
  ☆10Updated 3 weeks ago
• amd / ZenDNN-tensorflow-plugin
  ☆8Updated 3 weeks ago
• ROCm / rocSHMEM
  rocSHMEM intra-kernel networking runtime for AMD dGPUs on the ROCm platform.
  ☆98Updated this week
• wudu98 / autoGEMM
  ☆12Updated 8 months ago
• merthidayetoglu / CommBench
  A Micro-benchmarking Tool for HPC Networks
  ☆32Updated 2 weeks ago
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆102Updated 2 weeks ago
• ROCm / Megatron-LM
  Ongoing research training transformer models at scale
  ☆24Updated this week
• ROCm / MAD
  MAD (Model Automation and Dashboarding)
  ☆23Updated last week
• reger-men / HPL_GPU
  High-Performance Linpack Benchmark adopted version for GPU backend
  ☆11Updated 2 years ago
• ROCm / pytorch-micro-benchmarking
  ☆20Updated last week