togethercomputer / flash-attention-3Links
Fast and memory-efficient exact attention
☆23Updated 11 months ago
Alternatives and similar repositories for flash-attention-3
Users that are interested in flash-attention-3 are comparing it to the libraries listed below
Sorting:
- faster parallel inference of mochi-1 video generation model☆125Updated 8 months ago
- Making Flux go brrr on GPUs.☆154Updated 4 months ago
- [NeurIPS 2024] AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising☆207Updated last month
- ☆77Updated 10 months ago
- [WIP] Better (FP8) attention for Hopper☆32Updated 8 months ago
- [NeurIPS 2025] Radial Attention: O(nlogn) Sparse Attention with Energy Decay for Long Video Generation☆553Updated last week
- (WIP) Parallel inference for black-forest-labs' FLUX model.☆18Updated last year
- An open-source implementation of Regional Adaptive Sampling (RAS), a novel diffusion model sampling strategy that introduces regional var…☆146Updated 4 months ago
- [ICLR 2025] FasterCache: Training-Free Video Diffusion Model Acceleration with High Quality☆251Updated 10 months ago
- DC-Gen: Post-Training Diffusion Acceleration with Deeply Compressed Latent Space☆285Updated last month
- 🎬 3.7× faster video generation E2E 🖼️ 1.6× faster image generation E2E ⚡ ColumnSparseAttn 9.3× vs FlashAttn‑3 💨 ColumnSparseGEMM 2.5× …☆90Updated 2 months ago
- [arXiv] On-device Sora: Enabling Diffusion-Based Text-to-Video Generation for Mobile Devices☆126Updated 4 months ago
- SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention☆137Updated last week
- ☆95Updated last week
- Code for our ICCV 2025 paper "Adaptive Caching for Faster Video Generation with Diffusion Transformers"☆160Updated last year
- Code for Draft Attention☆93Updated 5 months ago
- Implementation of SmoothCache, a project aimed at speeding-up Diffusion Transformer (DiT) based GenAI models with error-guided caching.☆45Updated 4 months ago
- High-throughput tensor loading for PyTorch☆197Updated this week
- This repository provides a minimal, single-file implementation of SingLoRA (Single Matrix Low-Rank Adaptation) as described in the paper …☆45Updated last week
- ☆186Updated 10 months ago
- https://wavespeed.ai/ Context parallel attention that accelerates DiT model inference with dynamic caching☆388Updated 4 months ago
- Video-Infinity generates long videos quickly using multiple GPUs without extra training.☆186Updated last year
- Krea Realtime 14B. An open-source realtime AI video model.☆386Updated this week
- Official PyTorch implementation of TokenSet.☆127Updated 7 months ago
- [ICML2025, NeurIPS2025 Spotlight] Sparse VideoGen 1 & 2: Accelerating Video Diffusion Transformers with Sparse Attention☆575Updated last month
- A WebUI for Side-by-Side Comparison of Media (Images/Videos) Across Multiple Folders☆24Updated 8 months ago
- Writing FLUX in Triton☆41Updated last year
- [ICCV2025] From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeers☆329Updated 3 months ago
- End-to-end recipes for optimizing diffusion models with torchao and diffusers (inference and FP8 training).☆383Updated 5 months ago
- The official code for NeurIPS 2025 "MagCache: Fast Video Generation with Magnitude-Aware Cache"☆222Updated this week