Alternatives and similar repositories for fla-zoo

Users that are interested in fla-zoo are comparing it to the libraries listed below

• fla-org / flash-bidirectional-linear-attention
  Triton implement of bi-directional (non-causal) linear attention
  ☆56Updated 9 months ago
• Doraemonzzz / xmixers
  Xmixers: A collection of SOTA efficient token/channel mixers
  ☆29Updated 2 months ago
• OpenSparseLLMs / Linearization
  ☆61Updated 4 months ago
• AwesomeSeq / Comba-triton
  ☆49Updated 5 months ago
• qiuzh20 / gated_attention
  The official implementation for [NeurIPS2025 Oral] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink…
  ☆101Updated last month
• sustcsonglin / linear-attention-and-beyond-slides
  ☆96Updated 8 months ago
• jxiw / M1
  M1: Towards Scalable Test-Time Compute with Mamba Reasoning Models
  ☆45Updated 4 months ago
• HanGuo97 / log-linear-attention
  ☆253Updated 5 months ago
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆61Updated 4 months ago
• tilde-research / nsa-impl
  An efficient implementation of the NSA (Native Sparse Attention) kernel
  ☆124Updated 4 months ago
• 00ffcc / chunkRWKV6
  continous batching and parallel acceleration for RWKV6
  ☆22Updated last year
• IBM / selective-dense-state-space-model
  Open-sourcing code associated with the AAAI-25 paper "On the Expressiveness and Length Generalization of Selective State-Space Models on …
  ☆15Updated last month
• OpenSparseLLMs / MoM
  ☆106Updated 2 months ago
• zhixuan-lin / forgetting-transformer
  [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning
  ☆132Updated 2 weeks ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆39Updated last year
• xiayuqing0622 / flex_head_fa
  Fast and memory-efficient exact attention
  ☆74Updated 8 months ago
• howard-hou / RWKV-X
  RWKV-X is a Linear Complexity Hybrid Language Model based on the RWKV architecture, integrating Sparse Attention to improve the model's l…
  ☆51Updated 4 months ago
• deep-spin / adasplash
  AdaSplash: Adaptive Sparse Flash Attention (aka Flash Entmax Attention)
  ☆29Updated last month
• SqueezeAILab / SqueezedAttention
  [ACL 2025] Squeezed Attention: Accelerating Long Prompt LLM Inference
  ☆54Updated 11 months ago
• Anonymous1252022 / Megatron-DeepSpeed
  ☆14Updated last year
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆61Updated last year
• Infini-AI-Lab / Kinetics
  Kinetics: Rethinking Test-Time Scaling Laws
  ☆82Updated 4 months ago
• dame-cell / Triformer
  Transformers components but in Triton
  ☆34Updated 6 months ago
• HazyResearch / prefix-linear-attention
  ☆57Updated last year
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆36Updated last year
• nil0x9 / flash-muon
  Flash-Muon: An Efficient Implementation of Muon Optimizer
  ☆206Updated 5 months ago
• Doraemonzzz / Awesome-Triton-Resources
  Awesome Triton Resources
  ☆36Updated 6 months ago
• OpenSparseLLMs / Linear-MoE
  ☆120Updated 5 months ago
• TsinghuaC3I / Fourier-Position-Embedding
  [ICML 2025] Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization
  ☆103Updated 5 months ago
• sustcsonglin / fla-tilelang
  ☆21Updated 8 months ago