Repeerc / flash-attention-v2-RDNA3-minimalLinks
a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA environments.
☆43Updated 10 months ago
Alternatives and similar repositories for flash-attention-v2-RDNA3-minimal
Users that are interested in flash-attention-v2-RDNA3-minimal are comparing it to the libraries listed below
Sorting:
- Fast and memory-efficient exact attention☆174Updated this week
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆80Updated last month
- ☆137Updated this week
- ☆70Updated 6 months ago
- Ahead of Time (AOT) Triton Math Library☆66Updated last week
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆109Updated 11 months ago
- Development repository for the Triton language and compiler☆125Updated this week
- QQQ is an innovative and hardware-optimized W4A8 quantization solution for LLMs.☆128Updated 2 months ago
- PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu☆70Updated 6 months ago
- A CUDA kernel for NHWC GroupNorm for PyTorch☆19Updated 7 months ago
- 使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention☆71Updated 10 months ago
- A safetensors extension to efficiently store sparse quantized tensors on disk☆129Updated this week
- ☆48Updated last month
- (WIP) Parallel inference for black-forest-labs' FLUX model.☆19Updated 7 months ago
- Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.