Alternatives and similar repositories for AITemplate

Users that are interested in AITemplate are comparing it to the libraries listed below

• ROCm / triton
  Development repository for the Triton language and compiler
  ☆122Updated this week
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆174Updated this week
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆63Updated this week
• ROCm / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆76Updated this week
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆195Updated this week
• ColfaxResearch / cutlass-kernels
  ☆203Updated 10 months ago
• ROCm / TransformerEngine
  ☆34Updated this week
• ROCm / composable_kernel
  Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators
  ☆396Updated this week
• ROCm / rocmProfileData
  ☆24Updated last week
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆42Updated 8 months ago
• ROCm / hipBLASLt
  hipBLASLt is a library that provides general matrix-matrix operations with a flexible API and extends functionalities beyond a traditiona…
  ☆95Updated this week
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆248Updated 6 months ago
• ROCm / pytorch-micro-benchmarking
  ☆20Updated last month
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆185Updated this week
• ColfaxResearch / cfx-article-src
  ☆109Updated last week
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆61Updated 2 months ago
• NVIDIA / TensorRT-Incubator
  Experimental projects related to TensorRT
  ☆101Updated this week
• ROCm / rccl-tests
  RCCL Performance Benchmark Tests
  ☆64Updated this week
• ROCm / rocWMMA
  rocWMMA
  ☆111Updated this week
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆109Updated 10 months ago
• yifuwang / symm-mem-recipes
  ☆76Updated 4 months ago
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆97Updated 3 weeks ago
• ROCm / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆53Updated this week
• wmmae / wmma_extension
  An extension library of WMMA API (Tensor Core API)
  ☆96Updated 10 months ago
• AlibabaPAI / FLASHNN
  ☆94Updated 8 months ago
• SqueezeBits / QUICK
  QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference
  ☆117Updated last year
• ROCm / apex
  A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
  ☆22Updated this week
• north-numerical-computing / tensor-cores-numerical-behavior
  Test suite for probing the numerical behavior of NVIDIA tensor cores
  ☆38Updated 9 months ago
• Bruce-Lee-LY / cuda_hgemv
  Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.
  ☆61Updated 8 months ago
• ROCm / rocMLIR
  ☆143Updated this week