Alternatives and similar repositories for vllm-docs:

Users that are interested in vllm-docs are comparing it to the libraries listed below

• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆180Updated this week
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated 2 months ago
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆118Updated this week
• ROCm / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆75Updated this week
• ROCm / MAD
  ☆18Updated this week
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆102Updated this week
• north-numerical-computing / tensor-cores-numerical-behavior
  Test suite for probing the numerical behavior of NVIDIA tensor cores
  ☆37Updated 9 months ago
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆262Updated last month
• ROCm / TransformerEngine
  ☆29Updated this week
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆171Updated this week
• cchan / tccl
  extensible collectives library in triton
  ☆85Updated 3 weeks ago
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆18Updated 3 months ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆62Updated last month
• ROCm / rccl-tests
  RCCL Performance Benchmark Tests
  ☆64Updated this week
• argonne-lcf / LLM-Inference-Bench
  LLM-Inference-Bench
  ☆40Updated 3 months ago
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆95Updated this week
• triton-lang / kernels
  ☆78Updated 5 months ago
• ROCm / rocmProfileData
  ☆22Updated 2 months ago
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆58Updated this week
• ColfaxResearch / cutlass-kernels
  ☆198Updated 9 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆294Updated this week
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆182Updated this week
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆106Updated 9 months ago
• ROCm / hipBLASLt
  hipBLASLt is a library that provides general matrix-matrix operations with a flexible API and extends functionalities beyond a traditiona…
  ☆91Updated this week
• ROCm / Megatron-LM
  Ongoing research training transformer models at scale
  ☆18Updated this week
• intel / torch-xpu-ops
  ☆39Updated this week
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆193Updated this week
• run-ai / llmperf
  ☆53Updated 7 months ago
• mk1-project / quickreduce
  QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.
  ☆24Updated last month
• NVIDIA / nvidia-resiliency-ext
  NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …
  ☆150Updated last week