Alternatives and similar repositories for vllm-spyre

Users that are interested in vllm-spyre are comparing it to the libraries listed below

• llm-d / llm-d-benchmark
  llm-d benchmark scripts and tooling
  ☆25Updated last week
• HabanaAI / hccl_demo
  ☆22Updated last month
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆81Updated this week
• shixun404 / Fault-Tolerant-SGEMM-on-NVIDIA-GPUs
  Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs
  ☆12Updated 5 months ago
• IBM / autopilot
  A tool to detect infrastructure issues on cloud native AI systems
  ☆47Updated last month
• fmperf-project / fmperf
  Cloud Native Benchmarking of Foundation Models
  ☆41Updated last month
• intel / torch-xpu-ops
  ☆54Updated this week
• merthidayetoglu / HiCCL
  A hierarchical collective communications library with portable optimizations
  ☆36Updated 8 months ago
• hpdps-group / COCCL
  COCCL: Compression and precision co-aware collective communication library
  ☆24Updated 5 months ago
• caikit / caikit-nlp
  ☆12Updated last week
• PanZaifeng / RecFlex
  A recommendation model kernel optimizing system
  ☆10Updated 3 months ago
• azrael417 / mlperf-deepcam
  This is the public repo for the MLPerf DeepCAM climate data segmentation proposal.
  ☆16Updated 3 years ago
• LMCache / LMBenchmark
  Systematic and comprehensive benchmarks for LLM systems.
  ☆28Updated 3 weeks ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆62Updated 2 months ago
• ROCm / aws-ofi-rccl
  ☆16Updated 4 months ago
• astra-sim / symbolic_tensor_graph
  ☆20Updated last week
• ROCm / Megatron-LM
  Ongoing research training transformer models at scale
  ☆29Updated this week
• argonne-lcf / dlio_benchmark
  An I/O benchmark for deep Learning applications
  ☆90Updated last week
• NVIDIA / cloudai
  CloudAI Benchmark Framework
  ☆71Updated this week
• reger-men / HPL_GPU
  High-Performance Linpack Benchmark adopted version for GPU backend
  ☆11Updated 2 years ago
• merthidayetoglu / CommBench
  A Micro-benchmarking Tool for HPC Networks
  ☆32Updated last month
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆110Updated last week
• mk1-project / quickreduce
  QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.
  ☆32Updated last week
• arm-hpc-devkit / nvidia-arm-hpc-devkit-users-guide
  Get started with your NVIDIA Arm HPC Developers Kit!
  ☆33Updated 2 years ago
• mingfeima / pytorch_profiler_parser
  parser script to process pytorch autograd profiler result, convert json file to excel.
  ☆15Updated 5 years ago
• mlcommons / hpc
  Reference implementations of MLPerf™ HPC training benchmarks
  ☆49Updated 6 months ago
• intel / cutlass-sycl
  A CUTLASS implementation using SYCL
  ☆38Updated this week
• IBM / zDNN
  IBM Z Deep Neural Network Library (zDNN) provides an interface for applications making use of Neural Network Processing Assist Facility (…
  ☆16Updated 4 months ago
• ROCm / MAD
  MAD (Model Automation and Dashboarding)
  ☆24Updated this week
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆101Updated last month