[WIP] Better (FP8) attention for Hopper
☆34Feb 24, 2025Updated last year
Alternatives and similar repositories for QuantumAttention
Users that are interested in QuantumAttention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- (WIP) Parallel inference for black-forest-labs' FLUX model.☆19Nov 18, 2024Updated last year
- An experimental communicating attention kernel based on DeepEP.☆34Jul 29, 2025Updated 10 months ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆24Updated this week
- SGLang Kernel Wheel Index☆23Updated this week
- A CUDA kernel for NHWC GroupNorm for PyTorch☆23Nov 15, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆192Jan 14, 2025Updated last year
- Benchmark tests supporting the TiledCUDA library.☆19Nov 19, 2024Updated last year
- Quantized Attention on GPU☆44Nov 22, 2024Updated last year
- ☆52May 19, 2025Updated last year
- ☆33Feb 3, 2025Updated last year
- Triton kernels for Flux☆23Jul 7, 2025Updated 11 months ago
- ☆20Sep 28, 2024Updated last year
- A high-performance acceleration library dedicated to large-scale model training on AMD GPUs☆64Updated this week
- ☆26Feb 17, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Official repository Flash Local Linear Attention☆36May 28, 2026Updated last week
- Parsers for CUDA binary files☆25Dec 29, 2023Updated 2 years ago
- A parallelism VAE avoids OOM for high resolution image generation☆94May 8, 2026Updated last month
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated last year
- ☆20Dec 24, 2024Updated last year
- ☆66Apr 26, 2025Updated last year
- KsanaDiT: High-Performance DiT (Diffusion Transformer) Inference Framework for Video & Image Generation☆54May 13, 2026Updated 3 weeks ago
- GPTQ inference TVM kernel☆40Apr 25, 2024Updated 2 years ago
- No-GIL Python environment featuring NVIDIA Deep Learning libraries.☆71Apr 14, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [ICML2025, NeurIPS2025 Spotlight] Sparse VideoGen 1 & 2: Accelerating Video Diffusion Transformers with Sparse Attention☆678Mar 6, 2026Updated 3 months ago
- Distributed parallel 3D-Causal-VAE for efficient training and inference☆47Aug 20, 2025Updated 9 months ago
- ☆107May 31, 2025Updated last year
- ☆90Jan 23, 2025Updated last year
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆155May 10, 2025Updated last year
- Triton based sparse quantization attention kernel collection☆43Aug 29, 2025Updated 9 months ago
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆13Nov 23, 2024Updated last year
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆122Mar 13, 2024Updated 2 years ago
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆30Jan 22, 2026Updated 4 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- 📊 Research-focused SDXL training framework exploring novel optimization approaches. Goals include enhanced image quality, training stabi…☆21Jun 7, 2025Updated last year
- Multi-Level Triton Runner supporting Python, IR, PTX, AMDGCN, cubin and hasco.☆98May 8, 2026Updated last month
- ☆82Dec 27, 2024Updated last year
- Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocatio…☆108Sep 11, 2025Updated 8 months ago
- ☆121May 16, 2025Updated last year
- Beyond KV Caching: Shared Attention for Efficient LLMs☆20Jul 19, 2024Updated last year
- https://wavespeed.ai/ Context parallel attention that accelerates DiT model inference with dynamic caching☆427Jul 5, 2025Updated 11 months ago