Alternatives and similar repositories for FlashAttentionTritonLab

Users that are interested in FlashAttentionTritonLab are comparing it to the libraries listed below

• shreyansh26 / FlashAttention-PyTorch
  Implementation of FlashAttention in PyTorch
  ☆173Updated 10 months ago
• mit-han-lab / Block-Sparse-Attention
  A sparse attention kernel supporting mix sparse patterns
  ☆376Updated 9 months ago
• Kedreamix / pytorch-cppcuda-tutorial
  tutorial for writing custom pytorch cpp+cuda kernel, applied on volume rendering (NeRF)
  ☆29Updated last year
• xlite-dev / ffpa-attn
  🤖FFPA: Extend FlashAttention-2 with Split-D, ~O(1) SRAM complexity for large headdim, 1.8x~3x↑🎉 vs SDPA EA.
  ☆229Updated 3 months ago
• ByteDance-Seed / cudaLLM
  ☆121Updated 3 months ago
• dhcode-cpp / NSA-pytorch
  DeepSeek Native Sparse Attention pytorch implementation
  ☆108Updated last week
• attention-survey / Efficient_Attention_Survey
  A Survey of Efficient Attention Methods: Hardware-efficient, Sparse, Compact, and Linear Attention
  ☆226Updated 2 months ago
• RiseAI-Sys / DAX
  High performance inference engine for diffusion models
  ☆95Updated 2 months ago
• qingkelab / qingketalk
  青稞Talk
  ☆161Updated last week
• XunhaoLai / native-sparse-attention-triton
  Efficient triton implementation of Native Sparse Attention.
  ☆248Updated 5 months ago
• thu-nics / DiTFastAttn
  ☆186Updated 10 months ago
• xlite-dev / Awesome-DiT-Inference
  📚A curated list of Awesome Diffusion Inference Papers with Codes: Sampling, Cache, Quantization, Parallelism, etc.🎉
  ☆442Updated 3 months ago
• mit-han-lab / x-attention
  [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring
  ☆254Updated 4 months ago
• Tele-AI / TeleTron
  To pioneer training long-context multi-modal transformer models
  ☆62Updated 3 months ago
• thu-ml / SLA
  SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention
  ☆137Updated last week
• svg-project / flash-kmeans
  Fast and memory-efficient exact kmeans
  ☆122Updated last week
• NoakLiu / FastCache-xDiT
  FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation [Efficient ML Model]
  ☆45Updated 2 months ago
• weishengying / tiny-flash-attention
  使用 cutlass 实现 flash-attention 精简版，具有教学意义
  ☆50Updated last year
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆134Updated 2 years ago
• thu-nics / ViDiT-Q
  [ICLR'25] ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation
  ☆132Updated 7 months ago
• shawnricecake / draft-attention
  Code for Draft Attention
  ☆93Updated 5 months ago
• ailzhang / EfficientPyTorch
  Code release for book "Efficient Training in PyTorch"
  ☆110Updated 7 months ago
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
  ☆45Updated 5 months ago
• luliyucoordinate / cute-flash-attention
  Implement Flash Attention using Cute.
  ☆96Updated 11 months ago
• YuxueYang1204 / CudaDemo
  Implement custom operators in PyTorch with cuda/c++
  ☆73Updated 2 years ago
• caibucai22 / awesome-cuda
  Awesome code, projects, books, etc. related to CUDA
  ☆26Updated 3 months ago
• NVlabs / Fast-dLLM
  Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"
  ☆676Updated 3 weeks ago
• iclementine / optimize_softmax
  Optimize softmax in triton in many cases
  ☆21Updated last year
• liangyuwang / Tiny-FSDP
  Tiny-FSDP, a minimalistic re-implementation of the PyTorch FSDP
  ☆90Updated 3 months ago
• 66RING / tiny-flash-attention
  flash attention tutorial written in python, triton, cuda, cutlass
  ☆448Updated 6 months ago