Repeerc / flash-attention-v2-RDNA3-minimalLinks
a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA environments.
☆42Updated 9 months ago
Alternatives and similar repositories for flash-attention-v2-RDNA3-minimal
Users that are interested in flash-attention-v2-RDNA3-minimal are comparing it to the libraries listed below
Sorting:
- ☆70Updated 5 months ago
- Fast and memory-efficient exact attention☆172Updated last week
- AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (N…☆11Updated 11 months ago
- QQQ is an innovative and hardware-optimized W4A8 quantization solution for LLMs.☆124Updated last month
- ☆48Updated 3 weeks ago
- ☆130Updated 2 months ago
- A safetensors extension to efficiently store sparse quantized tensors on disk☆117Updated this week
- ☆36Updated this week
- Ahead of Time (AOT) Triton Math Library☆64Updated last week
- Development repository for the Triton language and compiler☆122Updated this week
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆109Updated 10 months ago
- Model Compression Toolbox for Large Language Models and Diffusion Models☆489Updated 2 months ago
- 🎬 3.7× faster video generation E2E 🖼️ 1.6× faster image generation E2E ⚡ ColumnSparseAttn 9.3× vs FlashAttn‑3 💨 ColumnSparseGEMM 2.5× …☆65Updated this week
- PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu☆66Updated 6 months ago
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆79Updated 3 weeks ago
- AI Tensor Engine for ROCm☆201Updated this week
- The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm☆126Updated this week
- Standalone Flash Attention v2 kernel without libtorch dependency☆109Updated 8 months ago
- ☆33Updated last year
- An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).☆251Updated 7 months ago
- ☆59Updated last month
- Fast Hadamard transform in CUDA, with a PyTorch interface☆195Updated last year
- ☆73Updated 4 months ago
- A CUDA kernel for NHWC GroupNorm for PyTorch☆18Updated 6 months ago
- ☆74Updated 6 months ago
- DeeperGEMM: crazy optimized version☆69Updated last month
- A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆36Updated last month
- 使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention☆68Updated 9 months ago
- Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.☆62Updated 8 months ago
- ☆96Updated 8 months ago