Alternatives and similar repositories for Block-Sparse-Attention

Users that are interested in Block-Sparse-Attention are comparing it to the libraries listed below

• mit-han-lab / x-attention
  [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring
  ☆261Updated 5 months ago
• mit-han-lab / flash-moba
  ☆210Updated last month
• thu-ml / SLA
  SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention
  ☆176Updated last week
• XunhaoLai / native-sparse-attention-triton
  Efficient triton implementation of Native Sparse Attention.
  ☆256Updated 7 months ago
• SandAI-org / MagiAttention
  A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training
  ☆590Updated this week
• thu-nics / DiTFastAttn
  ☆186Updated 11 months ago
• thu-nics / ViDiT-Q
  [ICLR'25] ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation
  ☆141Updated 9 months ago
• ByteDance-Seed / FlexPrefill
  Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
  ☆159Updated 2 months ago
• attention-survey / Efficient_Attention_Survey
  A Survey of Efficient Attention Methods: Hardware-efficient, Sparse, Compact, and Linear Attention
  ☆265Updated 3 weeks ago
• mit-han-lab / Quest
  [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
  ☆360Updated 5 months ago
• NVlabs / COAT
  [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training
  ☆256Updated 4 months ago
• microsoft / SeerAttention
  SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
  ☆180Updated 3 months ago
• xlite-dev / Awesome-DiT-Inference
  📚A curated list of Awesome Diffusion Inference Papers with Codes: Sampling, Cache, Quantization, Parallelism, etc.🎉
  ☆478Updated 3 weeks ago
• andy-yang-1 / DoubleSparse
  16-fold memory access reduction with nearly no loss
  ☆109Updated 9 months ago
• xdit-project / DistVAE
  A parallelism VAE avoids OOM for high resolution image generation
  ☆84Updated 4 months ago
• z-lab / sparselora
  [ICML 2025] SparseLoRA: Accelerating LLM Fine-Tuning with Contextual Sparsity
  ☆64Updated 5 months ago
• thu-ml / SpargeAttn
  [ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.
  ☆852Updated last week
• hao-ai-lab / Awesome-Video-Attention
  A curated list of recent papers on efficient video attention for video diffusion models, including sparsification, quantization, and cach…
  ☆52Updated last month
• NVlabs / Fast-dLLM
  Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"
  ☆748Updated 3 weeks ago
• sandyresearch / chipmunk
  🎬 3.7× faster video generation E2E 🖼️ 1.6× faster image generation E2E ⚡ ColumnSparseAttn 9.3× vs FlashAttn‑3 💨 ColumnSparseGEMM 2.5× …
  ☆99Updated 3 months ago
• stepfun-ai / Step3
  ☆440Updated 4 months ago
• maomaocun / dLLM-cache
  Official PyTorch implementation of the paper "dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Caching" (dLLM-Cache…
  ☆189Updated last month
• RiseAI-Sys / DAX
  High performance inference engine for diffusion models
  ☆101Updated 3 months ago
• svg-project / flash-kmeans
  Fast and memory-efficient exact kmeans
  ☆130Updated last month
• mit-han-lab / fouroversix
  Code for the paper “Four Over Six: More Accurate NVFP4 Quantization with Adaptive Block Scaling”
  ☆93Updated this week
• Dao-AILab / sonic-moe
  Accelerating MoE with IO and Tile-aware Optimizations
  ☆351Updated last week
• yuezhouhu / 2by4-pretrain
  Efficient 2:4 sparse training algorithms and implementations
  ☆58Updated last year
• osayamenja / FlashMoE
  Distributed MoE in a Single Kernel [NeurIPS '25]
  ☆157Updated this week
• ByteDance-Seed / cudaLLM
  ☆125Updated 4 months ago
• shawnricecake / draft-attention
  Code for Draft Attention
  ☆98Updated 7 months ago