Alternatives and similar repositories for fla-tilelang

Users that are interested in fla-tilelang are comparing it to the libraries listed below

• Dao-AILab / grouped-latent-attention
  ☆126Updated 3 months ago
• tile-ai / AttentionEngine
  ☆50Updated 4 months ago
• ByteDance-Seed / FlexPrefill
  Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
  ☆142Updated 4 months ago
• NonvolatileMemory / flash_tree_attn
  ☆18Updated 9 months ago
• IST-DASLab / HALO
  HALO: Hadamard-Assisted Low-Precision Optimization and Training method for finetuning LLMs. 🚀 The official implementation of https://arx…
  ☆20Updated 7 months ago
• andy-yang-1 / DoubleSparse
  16-fold memory access reduction with nearly no loss
  ☆105Updated 6 months ago
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆44Updated 10 months ago
• tilde-research / nsa-impl
  An efficient implementation of the NSA (Native Sparse Attention) kernel
  ☆115Updated 3 months ago
• attention-survey / Efficient_Attention_Survey
  A Survey of Efficient Attention Methods: Hardware-efficient, Sparse, Compact, and Linear Attention
  ☆181Updated last month
• INT-FlashAttention2024 / INT-FlashAttention
  ☆82Updated 8 months ago
• microsoft / AttentionEngine
  ☆97Updated 4 months ago
• FasterDecoding / TEAL
  ☆142Updated 7 months ago
• IST-DASLab / qutlass
  QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning
  ☆97Updated 2 weeks ago
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆121Updated 3 months ago
• DD-DuDa / BitDecoding
  A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.
  ☆59Updated 3 weeks ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆77Updated last year
• flashinfer-ai / cutlass-viz
  ☆64Updated 5 months ago
• SqueezeAILab / SqueezedAttention
  SQUEEZED ATTENTION: Accelerating Long Prompt LLM Inference
  ☆53Updated 10 months ago
• luliyucoordinate / cute-flash-attention
  Implement Flash Attention using Cute.
  ☆95Updated 9 months ago
• mit-han-lab / x-attention
  [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring
  ☆231Updated 2 months ago
• alexzhang13 / flashattention2-custom-mask
  Triton implementation of FlashAttention2 that adds Custom Masks.
  ☆135Updated last year
• yaof20 / Flash-RL
  Implementation for FP8/INT8 Rollout for RL training without performence drop.
  ☆207Updated last week
• nil0x9 / flash-muon
  Flash-Muon: An Efficient Implementation of Muon Optimizer
  ☆186Updated 3 months ago
• fla-org / fla-zoo
  Flash-Linear-Attention models beyond language
  ☆17Updated 3 weeks ago
• shadowpa0327 / Palu
  [ICLR 2025] Palu: Compressing KV-Cache with Low-Rank Projection
  ☆140Updated 7 months ago
• ByteDance-Seed / cudaLLM
  ☆107Updated last month
• fzyzcjy / torch_utils
  Utility scripts for PyTorch (e.g. Memory profiler that understands more low-level allocations such as NCCL)
  ☆53Updated 2 weeks ago
• yuezhouhu / 2by4-pretrain
  Efficient 2:4 sparse training algorithms and implementations
  ☆56Updated 9 months ago
• zhuzilin / flash-attention-with-sink
  ☆38Updated last month
• li-plus / flash-preference
  Accelerate LLM preference tuning via prefix sharing with a single line of code
  ☆43Updated 2 months ago