Alternatives and similar repositories for AITemplate

Users that are interested in AITemplate are comparing it to the libraries listed below

• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆47Updated last year
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆276Updated this week
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆130Updated last week
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆188Updated last week
• ROCm / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆101Updated this week
• ROCm / composable_kernel
  Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators
  ☆460Updated this week
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆207Updated this week
• ROCm / rocmProfileData
  ☆27Updated this week
• ColfaxResearch / cutlass-kernels
  ☆231Updated last year
• intel / torch-xpu-ops
  ☆55Updated this week
• nunchaku-tech / deepcompressor
  Model Compression Toolbox for Large Language Models and Diffusion Models
  ☆628Updated last month
• ColfaxResearch / cfx-article-src
  ☆139Updated 4 months ago
• RRZE-HPC / gpu-benches
  collection of benchmarks to measure basic GPU capabilities
  ☆416Updated 7 months ago
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆76Updated 2 weeks ago
• IST-DASLab / marlin
  FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
  ☆898Updated last year
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆265Updated 2 months ago
• intel / cutlass-sycl
  SYCL based CUTLASS implementation for Intel GPUs
  ☆39Updated this week
• mk1-project / quickreduce
  QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.
  ☆33Updated 2 weeks ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆62Updated 2 months ago
• ROCm / TransformerEngine
  ☆43Updated last week
• microsoft / triton-shared
  Shared Middle-Layer for Triton Compilation
  ☆286Updated 2 weeks ago
• ROCm / AMDMIGraphX
  AMD's graph optimization engine.
  ☆249Updated this week
• pranjalssh / fast.cu
  Fastest kernels written from scratch
  ☆343Updated 5 months ago
• ROCm / rocm-libraries
  monorepo for rocm libraries
  ☆112Updated this week
• NVIDIA / cudnn-frontend
  cudnn_frontend provides a c++ wrapper for the cudnn backend API and samples on how to use it
  ☆614Updated 2 weeks ago
• microsoft / BitBLAS
  BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
  ☆673Updated last month
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆365Updated this week
• mit-han-lab / omniserve
  [MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25] LServe: Efficient Long-sequence LLM Se…
  ☆753Updated 6 months ago
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆376Updated 11 months ago
• ROCm / hipBLASLt
  [DEPRECATED] Moved to ROCm/rocm-libraries repo
  ☆111Updated this week