Alternatives and similar repositories for aiter:

Users that are interested in aiter are comparing it to the libraries listed below

• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆183Updated this week
• ROCm / composable_kernel
  Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators
  ☆393Updated this week
• ROCm / hipBLASLt
  hipBLASLt is a library that provides general matrix-matrix operations with a flexible API and extends functionalities beyond a traditiona…
  ☆93Updated this week
• ppl-ai / pplx-kernels
  Perplexity GPU Kernels
  ☆272Updated last week
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆118Updated this week
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆63Updated 2 weeks ago
• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆345Updated last week
• ROCm / rccl
  ROCm Communication Collectives Library (RCCL)
  ☆330Updated this week
• triton-lang / triton-cpu
  An experimental CPU backend for Triton
  ☆110Updated last week
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆297Updated this week
• microsoft / triton-shared
  Shared Middle-Layer for Triton Compilation
  ☆246Updated 2 weeks ago
• ROCm / rccl-tests
  RCCL Performance Benchmark Tests
  ☆64Updated last week
• ColfaxResearch / cfx-article-src
  ☆104Updated last month
• ai-dynamo / nixl
  NVIDIA Inference Xfer Library (NIXL)
  ☆304Updated this week
• ColfaxResearch / cutlass-kernels
  ☆202Updated 9 months ago
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆264Updated last week
• ROCm / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆76Updated this week
• NVIDIA / TensorRT-Incubator
  Experimental projects related to TensorRT
  ☆99Updated last week
• ROCm / rocWMMA
  rocWMMA
  ☆110Updated last week
• ROCm / rocmProfileData
  ☆24Updated 2 months ago
• carlushuang / gcnasm
  amdgpu example code in hip/asm
  ☆31Updated 3 weeks ago
• ROCm / hipBLAS
  ROCm BLAS marshalling library
  ☆140Updated this week
• amd / ZenDNN
  ☆106Updated last month
• NVIDIA / Fuser
  A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
  ☆324Updated this week
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆173Updated this week
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆106Updated 9 months ago
• microsoft / BitBLAS
  BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
  ☆601Updated last week
• yifuwang / symm-mem-recipes
  ☆70Updated 4 months ago
• pranjalssh / fast.cu
  Fastest kernels written from scratch
  ☆256Updated last month
• ROCm / rocMLIR
  ☆142Updated this week