Alternatives and similar repositories for grouped-latent-attention

Users that are interested in grouped-latent-attention are comparing it to the libraries listed below

• Dao-AILab / gemm-cublas

  View on GitHub
  ☆22May 5, 2025Updated 9 months ago
• mit-han-lab / x-attention

  View on GitHub
  [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring
  ☆269Jul 6, 2025Updated 7 months ago
• mit-han-lab / flash-moba

  View on GitHub
  ☆223Nov 19, 2025Updated 2 months ago
• tilde-research / nsa-impl

  View on GitHub
  An efficient implementation of the NSA (Native Sparse Attention) kernel
  ☆129Jun 24, 2025Updated 7 months ago
• tile-ai / AttentionEngine

  View on GitHub
  ☆52May 19, 2025Updated 8 months ago
• tridao / flash-attention-wheels

  View on GitHub
  ☆61Nov 27, 2023Updated 2 years ago
• PiotrNawrot / sparse-frontier

  View on GitHub
  The evaluation framework for training-free sparse attention in LLMs
  ☆119Jan 27, 2026Updated 3 weeks ago
• GATECH-EIC / LaCache

  View on GitHub
  [ICML 2025] LaCache: Ladder-Shaped KV Caching for Efficient Long-Context Modeling of Large Language Models
  ☆17Nov 4, 2025Updated 3 months ago
• feifeibear / ChituAttention

  View on GitHub
  Quantized Attention on GPU
  ☆44Nov 22, 2024Updated last year
• zjq0455 / PTQ1.61

  View on GitHub
  ☆15Jan 12, 2026Updated last month
• sail-sg / SkyLadder

  View on GitHub
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆42Dec 29, 2025Updated last month
• edwardmilsom / function-space-learning-rates-paper

  View on GitHub
  Code for the paper "Function-Space Learning Rates"
  ☆25Jun 3, 2025Updated 8 months ago
• HanGuo97 / log-linear-attention

  View on GitHub
  ☆271Jun 6, 2025Updated 8 months ago
• yester31 / Cutlass_EX

  View on GitHub
  study of cutlass
  ☆22Nov 10, 2024Updated last year
• johanwind / wind_rwkv

  View on GitHub
  ☆27Jul 28, 2025Updated 6 months ago
• NathanGodey / qfilters

  View on GitHub
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆35Mar 7, 2025Updated 11 months ago
• dayal-kalra / low-memory-adam

  View on GitHub
  ☆14Mar 2, 2025Updated 11 months ago
• berlino / seq_icl

  View on GitHub
  ☆53May 20, 2024Updated last year
• Espere-1119-Song / VideoNSA

  View on GitHub
  VideoNSA: Native Sparse Attention Scales Video Understanding
  ☆78Nov 16, 2025Updated 3 months ago
• feifeibear / Odysseus-Transformer

  View on GitHub
  Odysseus: Playground of LLM Sequence Parallelism
  ☆79Jun 17, 2024Updated last year
• OpenSparseLLMs / MoM

  View on GitHub
  ☆121Feb 4, 2026Updated 2 weeks ago
• glassroom / heinsen_attention

  View on GitHub
  Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)
  ☆24Jun 6, 2024Updated last year
• meta-pytorch / attention-gym

  View on GitHub
  Helpful tools and examples for working with flex-attention
  ☆1,127Feb 8, 2026Updated last week
• fla-org / native-sparse-attention

  View on GitHub
  🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"
  ☆965Feb 5, 2026Updated last week
• Anonymous1252022 / Megatron-DeepSpeed

  View on GitHub
  ☆15Sep 22, 2024Updated last year
• TiledTensor / TiledBench

  View on GitHub
  Benchmark tests supporting the TiledCUDA library.
  ☆18Nov 19, 2024Updated last year
• JingMog / THOR

  View on GitHub
  Official Implementation of our paper "THOR: Tool-Integrated Hierarchical Optimization via RL for Mathematical Reasoning".
  ☆31Sep 19, 2025Updated 4 months ago
• flashinfer-ai / cutlass-viz

  View on GitHub
  ☆65Apr 26, 2025Updated 9 months ago
• nil0x9 / flash-muon

  View on GitHub
  Flash-Muon: An Efficient Implementation of Muon Optimizer
  ☆235Jun 15, 2025Updated 8 months ago
• KuangjuX / AttnLink

  View on GitHub
  An experimental communicating attention kernel based on DeepEP.
  ☆35Jul 29, 2025Updated 6 months ago
• ByteDance-Seed / Triton-distributed

  View on GitHub
  Distributed Compiler based on Triton for Parallel Systems
  ☆1,358Updated this week
• apple / ml-cross-entropy

  View on GitHub
  ☆579Sep 23, 2025Updated 4 months ago
• piotrpiekos / MoSA

  View on GitHub
  User-friendly implementation of the Mixture-of-Sparse-Attention (MoSA). MoSA selects distinct tokens for each head with expert choice rou…
  ☆28May 3, 2025Updated 9 months ago
• OpenNLPLab / LASP

  View on GitHub
  Linear Attention Sequence Parallelism (LASP)
  ☆88Jun 4, 2024Updated last year
• tensorgi / TPA

  View on GitHub
  [NeurIPS 2025 Spotlight] TPA: Tensor ProducT ATTenTion Transformer (T6) (https://arxiv.org/abs/2501.06425)
  ☆446Jan 26, 2026Updated 3 weeks ago
• MuLabPKU / TransMLA

  View on GitHub
  TransMLA: Multi-Head Latent Attention Is All You Need (NeurIPS 2025 Spotlight)
  ☆430Sep 23, 2025Updated 4 months ago
• Hon-Wong / ByteVideoLLM

  View on GitHub
  [ICCV 2025] Dynamic-VLM
  ☆28Dec 16, 2024Updated last year
• shawnricecake / draft-attention

  View on GitHub
  Code for Draft Attention
  ☆99May 22, 2025Updated 8 months ago
• ademeure / DeeperGEMM

  View on GitHub
  DeeperGEMM: crazy optimized version
  ☆74May 5, 2025Updated 9 months ago