NVFP4 Flash-Attention 4 on BlackWell
☆69Sep 26, 2026Updated last month
Alternatives and similar repositories for flash-attention-fp4
Users that are interested in flash-attention-fp4 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆31Jan 22, 2026Updated 9 months ago
- DeeperGEMM: crazy optimized version☆85May 5, 2025Updated last year
- Easy recipes to speed up latency of Flux, QwenImage, and LTX-2 with NVFP4 and MXFP8 on Blackwell.☆14Apr 10, 2026Updated 7 months ago
- ☆11May 21, 2026Updated 5 months ago
- ☆37Aug 7, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Benchmark tests supporting the TiledCUDA library.☆19Nov 19, 2024Updated last year
- ☆23May 5, 2025Updated last year
- This repository contains companion software for the Colfax Research paper "Categorical Foundations for CuTe Layouts".☆147Aug 15, 2026Updated 2 months ago
- ☆13Updated this week
- ☆64Sep 27, 2026Updated last month
- a repo to study TensorRT Plugin☆11Apr 30, 2025Updated last year
- ☆53May 20, 2025Updated last year
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆205Sep 2, 2026Updated 2 months ago
- A curated list of recent papers on efficient video attention for video diffusion models, including sparsification, quantization, and cach…☆69Oct 27, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆54May 19, 2025Updated last year
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 4 months ago
- Ulysses sequence-parallel all-to-all as a torch custom op, moved by the GPU copy engines into torch symmetric memory. Zero SM usage; 1.66…☆55Aug 25, 2026Updated 2 months ago
- NCU-driven iterative optimization workflow for CUDA/CUTLASS/Triton/CuTe DSL kernels.☆25Apr 10, 2026Updated 7 months ago
- Code for the papers: “Four Over Six: More Accurate NVFP4 Quantization with Adaptive Block Scaling” and “Adaptive Block-Scaled Data Types”☆211Apr 21, 2026Updated 6 months ago
- Some funny cute/cuteDSL code snippets☆35Mar 2, 2026Updated 8 months ago
- An experimental communicating attention kernel based on DeepEP.☆34Jul 29, 2025Updated last year
- ⚡️Qwen-Image 4.8x🎉 speedup with Hybrid Acceleration for low VRAM GPUs☆17Oct 24, 2025Updated last year
- [CVPR 2025] The official implementation of "CacheQuant: Comprehensively Accelerated Diffusion Models"☆51Nov 2, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- FlashTile is a CUDA Tile IR compiler that is compatible with NVIDIA's tileiras, targeting SM70 through SM121 NVIDIA GPUs.☆62Feb 6, 2026Updated 9 months ago
- ☆271Jul 11, 2024Updated 2 years ago
- ☆40Dec 14, 2025Updated 10 months ago
- ☆47Aug 3, 2026Updated 3 months ago
- a size profiler for cuda binary☆74Oct 3, 2026Updated last month
- CUTLASS and CuTe Examples☆143Nov 30, 2025Updated 11 months ago
- FlashInfer Bench @ MLSys 2026: Building AI agents to write high performance GPU kernels☆186Apr 26, 2026Updated 6 months ago
- FLA but cuTile☆27Apr 17, 2026Updated 6 months ago
- Distributed MoE in a Single Kernel [NeurIPS '25]☆338May 5, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆37Mar 7, 2025Updated last year
- Execution-state orchestration layer for FlashRT: model-runtime adoption, stage-DAG scheduling, RTC action chunks, and capsule state contr…☆13Sep 7, 2026Updated 2 months ago
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Sep 11, 2026Updated 2 months ago
- MSLK (Meta Superintelligence Labs Kernels) is a collection of PyTorch GPU operator libraries that are designed and optimized for GenAI tr…☆166Updated this week
- ☆32Jul 2, 2025Updated last year
- Sample Codes using NVSHMEM on Multi-GPU☆30Jan 22, 2023Updated 3 years ago
- Quantized Attention on GPU☆45Nov 22, 2024Updated last year
Are these results useful?