Alternatives and similar repositories for flash-attention-3

Users that are interested in flash-attention-3 are comparing it to the libraries listed below

• xdit-project / mochi-xdit
  faster parallel inference of mochi-1 video generation model
  ☆125Updated 9 months ago
• huggingface / flux-fast
  Making Flux go brrr on GPUs.
  ☆157Updated 4 months ago
• thu-ml / SLA
  SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention
  ☆143Updated 3 weeks ago
• KONAKONA666 / q8_kernels
  ☆76Updated 11 months ago
• czg1225 / AsyncDiff
  [NeurIPS 2024] AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising
  ☆208Updated 2 months ago
• WaveSpeedAI / QuantumAttention
  [WIP] Better (FP8) attention for Hopper
  ☆32Updated 9 months ago
• eai-lab / On-device-Sora
  [arXiv] On-device Sora: Enabling Diffusion-Based Text-to-Video Generation for Mobile Devices
  ☆128Updated 2 weeks ago
• shawnricecake / draft-attention
  Code for Draft Attention
  ☆96Updated 6 months ago
• Vchitect / FasterCache
  [ICLR 2025] FasterCache: Training-Free Video Diffusion Model Acceleration with High Quality
  ☆254Updated 11 months ago
• sandyresearch / chipmunk
  🎬 3.7× faster video generation E2E 🖼️ 1.6× faster image generation E2E ⚡ ColumnSparseAttn 9.3× vs FlashAttn‑3 💨 ColumnSparseGEMM 2.5× …
  ☆94Updated 3 months ago
• AdaCache-DiT / AdaCache
  Code for our ICCV 2025 paper "Adaptive Caching for Faster Video Generation with Diffusion Transformers"
  ☆161Updated last year
• kyegomez / SingLoRA
  This repository provides a minimal, single-file implementation of SingLoRA (Single Matrix Low-Rank Adaptation) as described in the paper …
  ☆44Updated last week
• chengzeyi / piflux
  (WIP) Parallel inference for black-forest-labs' FLUX model.
  ☆18Updated last year
• dc-ai-projects / DC-Gen
  DC-Gen: Post-Training Diffusion Acceleration with Deeply Compressed Latent Space
  ☆300Updated 2 months ago
• mit-han-lab / radial-attention
  [NeurIPS 2025] Radial Attention: O(nlogn) Sparse Attention with Energy Decay for Long Video Generation
  ☆561Updated last month
• mit-han-lab / VisCompare
  A WebUI for Side-by-Side Comparison of Media (Images/Videos) Across Multiple Folders
  ☆24Updated 9 months ago
• Gengzigang / TokenSet
  Official PyTorch implementation of TokenSet.
  ☆127Updated 8 months ago
• Cornell-RelaxML / qtip
  ☆159Updated 5 months ago
• thu-nics / DiTFastAttn
  ☆187Updated 10 months ago
• svg-project / Sparse-VideoGen
  [ICML2025, NeurIPS2025 Spotlight] Sparse VideoGen 1 & 2: Accelerating Video Diffusion Transformers with Sparse Attention
  ☆593Updated 3 weeks ago
• microsoft / RAS
  An open-source implementation of Regional Adaptive Sampling (RAS), a novel diffusion model sampling strategy that introduces regional var…
  ☆148Updated 5 months ago
• Roblox / SmoothCache
  Implementation of SmoothCache, a project aimed at speeding-up Diffusion Transformer (DiT) based GenAI models with error-guided caching.
  ☆46Updated 4 months ago
• snu-mllab / KVzip
  [NeurIPS'25 Oral] Query-agnostic KV cache eviction: 3–4× reduction in memory and 2× decrease in latency (Qwen3/2.5, Gemma3, LLaMA3)
  ☆155Updated last week
• Lucky-Lance / TerDiT
  TerDiT: Ternary Diffusion Models with Transformers
  ☆72Updated last year
• fal-ai / flashpack
  High-throughput tensor loading for PyTorch
  ☆209Updated last week
• Huage001 / LinFusion
  Official PyTorch and Diffusers Implementation of "LinFusion: 1 GPU, 1 Minute, 16K Image"
  ☆310Updated 11 months ago
• yandex-research / switti
  (CVPR 2025) Switti: Designing Scale-Wise Transformers for Text-to-Image Synthesis
  ☆200Updated 4 months ago
• Yuanshi9815 / Video-Infinity
  Video-Infinity generates long videos quickly using multiple GPUs without extra training.
  ☆188Updated last year
• NVlabs / QeRL
  QeRL enables RL for 32B LLMs on a single H100 GPU.
  ☆459Updated 2 weeks ago
• chengzeyi / ParaAttention
  https://wavespeed.ai/ Context parallel attention that accelerates DiT model inference with dynamic caching
  ☆402Updated 5 months ago