Alternatives and similar repositories for vllm-spyre

Users that are interested in vllm-spyre are comparing it to the libraries listed below

• shixun404 / Fault-Tolerant-SGEMM-on-NVIDIA-GPUs
  Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs
  ☆12Updated 7 months ago
• LMCache / LMBenchmark
  Systematic and comprehensive benchmarks for LLM systems.
  ☆38Updated last month
• merthidayetoglu / HiCCL
  A hierarchical collective communications library with portable optimizations
  ☆36Updated 11 months ago
• llm-d / llm-d-benchmark
  llm-d benchmark scripts and tooling
  ☆31Updated this week
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆84Updated this week
• ROCm / rocSHMEM
  rocSHMEM intra-kernel networking runtime for AMD dGPUs on the ROCm platform.
  ☆123Updated this week
• IBM / autopilot
  A tool to detect infrastructure issues on cloud native AI systems
  ☆49Updated last month
• astra-sim / tacos
  TACOS: [T]opology-[A]ware [Co]llective Algorithm [S]ynthesizer for Distributed Machine Learning
  ☆28Updated 4 months ago
• spcl / atlahs
  ATLAHS: An Application-centric Network Simulator Toolchain for AI, HPC, and Distributed Storage
  ☆49Updated last week
• mk1-project / quickreduce
  QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.
  ☆35Updated 2 months ago
• PanZaifeng / RecFlex
  A recommendation model kernel optimizing system
  ☆12Updated 5 months ago
• NVIDIA / cloudai
  CloudAI Benchmark Framework
  ☆73Updated this week
• merthidayetoglu / CommBench
  A Micro-benchmarking Tool for HPC Networks
  ☆32Updated 2 months ago
• fmperf-project / fmperf
  Cloud Native Benchmarking of Foundation Models
  ☆44Updated 3 months ago
• ai-dynamo / aiconfigurator
  Offline optimization of your disaggregated Dynamo graph
  ☆97Updated this week
• microsoft / NPKit
  NCCL Profiling Kit
  ☆145Updated last year
• temporal-hpc / reduction-tensor-cores
  Fast GPU based tensor core reductions
  ☆13Updated 2 years ago
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆121Updated last week
• azrael417 / mlperf-deepcam
  This is the public repo for the MLPerf DeepCAM climate data segmentation proposal.
  ☆16Updated last month
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆63Updated 4 months ago
• mlcommons / hpc
  Reference implementations of MLPerf™ HPC training benchmarks
  ☆49Updated 8 months ago
• astra-sim / symbolic_tensor_graph
  ☆26Updated 2 months ago
• uuudown / Tartan
  Tartan: Evaluating Modern GPU Interconnect via a Multi-GPU Benchmark Suite
  ☆66Updated 7 years ago
• hpdps-group / COCCL
  COCCL: Compression and precision co-aware collective communication library
  ☆27Updated 7 months ago
• Azure / msccl
  Microsoft Collective Communication Library
  ☆66Updated 11 months ago
• ROCm / MAD
  MAD (Model Automation and Dashboarding)
  ☆29Updated last week
• mlcommons / chakra
  Repository for MLCommons Chakra schema and tools
  ☆133Updated 2 weeks ago
• intel / sycl-tla
  SYCL* Templates for Linear Algebra (SYCL*TLA) - SYCL based CUTLASS implementation for Intel GPUs
  ☆49Updated this week
• mlcommons / chakra-old
  Repository for MLCommons Chakra schema and tools
  ☆39Updated last year
• KernelTuner / kernel_launcher
  Using C++ magic to capture CUDA kernels and tune them with Kernel Tuner
  ☆21Updated last month