Alternatives and similar repositories for AITemplate:

Users that are interested in AITemplate are comparing it to the libraries listed below

• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆152Updated this week
• ROCm / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆57Updated this week
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆104Updated this week
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆157Updated this week
• ROCm / pytorch-micro-benchmarking
  ☆18Updated 2 months ago
• ROCm / composable_kernel
  Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators
  ☆338Updated this week
• ROCm / AMDMIGraphX
  AMD's graph optimization engine.
  ☆196Updated this week
• ROCm / TransformerEngine
  ☆15Updated this week
• ColfaxResearch / cutlass-kernels
  ☆180Updated 6 months ago
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆35Updated 5 months ago
• ROCm / hipBLASLt
  hipBLASLt is a library that provides general matrix-matrix operations with a flexible API and extends functionalities beyond a traditiona…
  ☆73Updated this week
• ROCm / rocmProfileData
  ☆19Updated this week
• ROCm / rccl-tests
  RCCL Performance Benchmark Tests
  ☆55Updated 2 weeks ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆58Updated last month
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆232Updated 3 months ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆94Updated 6 months ago
• ROCm / hipBLAS
  ROCm BLAS marshalling library
  ☆127Updated this week
• RRZE-HPC / gpu-benches
  collection of benchmarks to measure basic GPU capabilities
  ☆287Updated 3 weeks ago
• north-numerical-computing / tensor-cores-numerical-behavior
  Test suite for probing the numerical behavior of NVIDIA tensor cores
  ☆37Updated 6 months ago
• ROCm / rdc
  RDC
  ☆26Updated this week
• ROCm / Tensile
  Stretching GPU performance for GEMMs and tensor contractions.
  ☆231Updated this week
• ROCm / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆42Updated 2 weeks ago
• wmmae / wmma_extension
  An extension library of WMMA API (Tensor Core API)
  ☆87Updated 6 months ago
• AlibabaPAI / FLASHNN
  ☆79Updated 4 months ago
• NVIDIA / Fuser
  A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
  ☆294Updated this week
• triton-lang / kernels
  ☆64Updated 2 months ago
• ROCm / rocm-examples
  A collection of examples for the ROCm software stack
  ☆179Updated this week
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆199Updated last week
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆216Updated last week