Alternatives and similar repositories for linear-attention-and-beyond-slides

Users that are interested in linear-attention-and-beyond-slides are comparing it to the libraries listed below

• hazan-lab / flash-stu

  View on GitHub
  PyTorch implementation of the Flash Spectral Transform Unit.
  ☆21Sep 19, 2024Updated last year
• sustcsonglin / fla-tilelang

  View on GitHub
  ☆35Mar 7, 2025Updated 11 months ago
• TiledTensor / TiledBench

  View on GitHub
  Benchmark tests supporting the TiledCUDA library.
  ☆18Nov 19, 2024Updated last year
• microsoft / AttentionEngine

  View on GitHub
  ☆118May 19, 2025Updated 8 months ago
• fla-org / native-sparse-attention

  View on GitHub
  🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"
  ☆965Feb 5, 2026Updated last week
• allenai / signal-and-noise

  View on GitHub
  Measuring the Signal to Noise Ratio in Language Model Evaluation
  ☆28Aug 19, 2025Updated 5 months ago
• OpenSparseLLMs / Linear-MoE

  View on GitHub
  ☆129Jun 6, 2025Updated 8 months ago
• flashinfer-ai / cutlass-viz

  View on GitHub
  ☆65Apr 26, 2025Updated 9 months ago
• srush / tangent

  View on GitHub
  Source-to-Source Debuggable Derivatives in Pure Python
  ☆15Jan 23, 2024Updated 2 years ago
• InternLM / turbomind

  View on GitHub
  ☆97Mar 26, 2025Updated 10 months ago
• feifeibear / ChituAttention

  View on GitHub
  Quantized Attention on GPU
  ☆44Nov 22, 2024Updated last year
• fla-org / flash-linear-attention

  View on GitHub
  🚀 Efficient implementations of state-of-the-art linear attention models
  ☆4,379Updated this week
• cherichy / tilecute

  View on GitHub
  ☆32Jul 2, 2025Updated 7 months ago
• zhixuan-lin / forgetting-transformer

  View on GitHub
  [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning
  ☆137Dec 19, 2025Updated last month
• tile-ai / AttentionEngine

  View on GitHub
  ☆52May 19, 2025Updated 8 months ago
• WeiHuang05 / Awesome_Large_Foundation_Model_Theory

  View on GitHub
  Welcome to the 'In Context Learning Theory' Reading Group
  ☆30Nov 8, 2024Updated last year
• WaveSpeedAI / QuantumAttention

  View on GitHub
  [WIP] Better (FP8) attention for Hopper
  ☆32Feb 24, 2025Updated 11 months ago
• mit-han-lab / x-attention

  View on GitHub
  [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring
  ☆269Jul 6, 2025Updated 7 months ago
• LLM360 / k2-train

  View on GitHub
  ☆52Jun 6, 2024Updated last year
• zhuzilin / flash-attention-with-sink

  View on GitHub
  ☆38Aug 7, 2025Updated 6 months ago
• fla-org / flash-bidirectional-linear-attention

  View on GitHub
  Triton implement of bi-directional (non-causal) linear attention
  ☆65Feb 2, 2026Updated 2 weeks ago
• chhzh123 / ptc-tutorial

  View on GitHub
  PyTorch compilation tutorial covering TorchScript, torch.fx, and Slapo
  ☆17Mar 13, 2023Updated 2 years ago
• formll / resolving-scaling-law-discrepancies

  View on GitHub
  ☆20Nov 4, 2025Updated 3 months ago
• NVlabs / COAT

  View on GitHub
  [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training
  ☆258Aug 9, 2025Updated 6 months ago
• fla-org / flame

  View on GitHub
  🔥 A minimal training framework for scaling FLA models
  ☆344Nov 15, 2025Updated 3 months ago
• Doraemonzzz / xmixers

  View on GitHub
  Xmixers: A collection of SOTA efficient token/channel mixers
  ☆28Sep 4, 2025Updated 5 months ago
• XunhaoLai / native-sparse-attention-triton

  View on GitHub
  Efficient triton implementation of Native Sparse Attention.
  ☆263May 23, 2025Updated 8 months ago
• Yifei-Zuo / Flash-LLA

  View on GitHub
  Official repository for the paper Local Linear Attention: An Optimal Interpolation of Linear and Softmax Attention For Test-Time Regressi…
  ☆23Oct 1, 2025Updated 4 months ago
• nil0x9 / flash-muon

  View on GitHub
  Flash-Muon: An Efficient Implementation of Muon Optimizer
  ☆235Jun 15, 2025Updated 8 months ago
• lianakoleva / no-libtorch-compile

  View on GitHub
  ☆21Mar 3, 2025Updated 11 months ago
• mit-han-lab / Block-Sparse-Attention

  View on GitHub
  A sparse attention kernel supporting mix sparse patterns
  ☆455Jan 18, 2026Updated 3 weeks ago
• ByteDance-Seed / Triton-distributed

  View on GitHub
  Distributed Compiler based on Triton for Parallel Systems
  ☆1,350Feb 9, 2026Updated last week
• cloneofsimo / ptx-tutorial-by-aislop

  View on GitHub
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆66Mar 24, 2025Updated 10 months ago
• OpenSparseLLMs / Linearization

  View on GitHub
  ☆66Jul 8, 2025Updated 7 months ago
• JamyDon / PLM-based-CGEC-Model-Ensemble

  View on GitHub
  [ACL 2023] Are Pre-trained Language Models Useful for Model Ensemble in Chinese Grammatical Error Correction?
  ☆10Dec 15, 2025Updated 2 months ago
• AMDResearch / intelliperf

  View on GitHub
  Automated bottleneck detection and solution orchestration
  ☆19Updated this week
• qiuk2 / RobusTok

  View on GitHub
  Image Tokenizer Needs Post-Training
  ☆24Oct 4, 2025Updated 4 months ago
• simveit / persistent_dense_gemm

  View on GitHub
  Persistent dense gemm for Hopper in `CuTeDSL`
  ☆15Aug 9, 2025Updated 6 months ago
• xjdr-alt / mla_blog_translation

  View on GitHub
  ☆13Jun 18, 2024Updated last year