Alternatives and similar repositories for vllm-docs:

Users that are interested in vllm-docs are comparing it to the libraries listed below

• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆119Updated this week
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆114Updated this week
• ROCm / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆69Updated this week
• cchan / tccl
  extensible collectives library in triton
  ☆84Updated 6 months ago
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆21Updated last month
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆56Updated last week
• intel / torch-xpu-ops
  ☆37Updated this week
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆250Updated last week
• NVIDIA / nvidia-resiliency-ext
  NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …
  ☆109Updated last week
• ROCm / TransformerEngine
  ☆25Updated this week
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• ROCm / rocmProfileData
  ☆21Updated last month
• Cornell-RelaxML / qtip
  ☆112Updated this week
• ROCm / MAD
  ☆15Updated last week
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆91Updated this week
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆235Updated last month
• NVIDIA / NeMo-Run
  A tool to configure, launch and manage your machine learning experiments.
  ☆132Updated this week
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆272Updated this week
• mk1-project / quickreduce
  ☆22Updated last week
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆170Updated this week
• triton-lang / kernels
  ☆73Updated 4 months ago
• run-ai / llmperf
  ☆54Updated 6 months ago
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆91Updated 2 weeks ago
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆162Updated this week
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆108Updated last year
• deepspeedai / DeepSpeed-Kernels
  ☆62Updated last month
• yifuwang / symm-mem-recipes
  ☆57Updated 3 months ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆64Updated 3 years ago
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆17Updated 2 months ago
• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆55Updated last month