[WIP] Better (FP8) attention for Hopper
☆32Feb 24, 2025Updated last year
Alternatives and similar repositories for QuantumAttention
Users that are interested in QuantumAttention are comparing it to the libraries listed below
Sorting:
- (WIP) Parallel inference for black-forest-labs' FLUX model.☆18Nov 18, 2024Updated last year
- Kernel Library Wheel for SGLang☆17Updated this week
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆21Feb 9, 2026Updated 2 weeks ago
- Benchmark tests supporting the TiledCUDA library.☆18Nov 19, 2024Updated last year
- An experimental communicating attention kernel based on DeepEP.☆35Jul 29, 2025Updated 7 months ago
- ☆190Jan 14, 2025Updated last year
- Quantized Attention on GPU☆44Nov 22, 2024Updated last year
- Triton kernels for Flux☆22Jul 7, 2025Updated 7 months ago
- ☆34Feb 3, 2025Updated last year
- A CUDA kernel for NHWC GroupNorm for PyTorch☆23Nov 15, 2024Updated last year
- ☆52May 19, 2025Updated 9 months ago
- ☆20Sep 28, 2024Updated last year
- Xmixers: A collection of SOTA efficient token/channel mixers☆28Sep 4, 2025Updated 5 months ago
- Beyond KV Caching: Shared Attention for Efficient LLMs☆20Jul 19, 2024Updated last year
- Official repository for the paper Local Linear Attention: An Optimal Interpolation of Linear and Softmax Attention For Test-Time Regressi…☆23Oct 1, 2025Updated 4 months ago
- ☆26Feb 17, 2025Updated last year
- Parsers for CUDA binary files☆24Dec 29, 2023Updated 2 years ago
- A parallelism VAE avoids OOM for high resolution image generation☆85Aug 4, 2025Updated 6 months ago
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆27Jan 22, 2026Updated last month
- ☆85Jan 23, 2025Updated last year
- Aims to implement dual-port and multi-qp solutions in deepEP ibrc transport☆73May 9, 2025Updated 9 months ago
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated last year
- No-GIL Python environment featuring NVIDIA Deep Learning libraries.☆70Apr 14, 2025Updated 10 months ago
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆237Jun 15, 2025Updated 8 months ago
- ☆88May 31, 2025Updated 9 months ago
- A tiny FP8 multiplication unit written in Verilog. TinyTapeout 2 submission.☆14Nov 23, 2022Updated 3 years ago
- Shor's algorithm simulation using CUDA☆19Nov 10, 2019Updated 6 years ago
- ☆65Apr 26, 2025Updated 10 months ago
- Transformers components but in Triton☆34May 9, 2025Updated 9 months ago
- ☆87Updated this week
- ☆115May 16, 2025Updated 9 months ago
- Debug print operator for cudagraph debugging☆14Aug 2, 2024Updated last year
- ☆15Aug 6, 2018Updated 7 years ago
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆14Nov 23, 2024Updated last year
- DeeperGEMM: crazy optimized version☆74May 5, 2025Updated 9 months ago
- ☆60Updated this week
- Handwritten GEMM using Intel AMX (Advanced Matrix Extension)☆17Jan 11, 2025Updated last year
- Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.☆166Jan 22, 2026Updated last month
- ☆39Apr 27, 2024Updated last year