Alternatives and similar repositories for sparse-attention-hub

Users that are interested in sparse-attention-hub are comparing it to the libraries listed below

• Anonymous1252022 / Megatron-DeepSpeed
  ☆15Updated last year
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆41Updated 2 weeks ago
• metacarbon / shareAtt
  Beyond KV Caching: Shared Attention for Efficient LLMs
  ☆20Updated last year
• dongwonjo / FastKV
  Official Implementation of FastKV: Decoupling of Context Reduction and KV Cache Compression for Prefill-Decoding Acceleration
  ☆29Updated last month
• PiotrNawrot / sparse-frontier
  The evaluation framework for training-free sparse attention in LLMs
  ☆108Updated 2 months ago
• Infini-AI-Lab / Kinetics
  Kinetics: Rethinking Test-Time Scaling Laws
  ☆85Updated 6 months ago
• sail-sg / SimLayerKV
  The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.
  ☆52Updated last year
• GATECH-EIC / LaCache
  [ICML 2025] LaCache: Ladder-Shaped KV Caching for Efficient Long-Context Modeling of Large Language Models
  ☆17Updated 2 months ago
• tilde-research / nsa-impl
  An efficient implementation of the NSA (Native Sparse Attention) kernel
  ☆128Updated 6 months ago
• thunlp / SparsingLaw
  The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".
  ☆29Updated last year
• Infini-AI-Lab / gsm_infinite
  ☆61Updated 6 months ago
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆35Updated 10 months ago
• zhang677 / PCL-lite
  Code for "Adaptive Self-improvement LLM Agentic System for ML Library Development" (ICML 2025)
  ☆14Updated this week
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …
  ☆60Updated last year
• Infini-AI-Lab / Sirius
  Sirius, an efficient correction mechanism, which significantly boosts Contextual Sparsity models on reasoning tasks while maintaining its…
  ☆21Updated last year
• AI9Stars / AutoTriton
  ☆60Updated 5 months ago
• Linking-ai / SCOPE
  (ACL 2025 oral) SCOPE: Optimizing KV Cache Compression in Long-context Generation
  ☆33Updated 7 months ago
• Lyun0912-wu / LongAttn
  LongAttn ：Selecting Long-context Training Data via Token-level Attention
  ☆15Updated 5 months ago
• hyx1999 / SAM-Decoding
  Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton
  ☆39Updated 10 months ago
• hdong920 / GRIFFIN
  ☆39Updated last year
• THU-KEG / PairJudgeRM
  ☆14Updated 8 months ago
• OpenSparseLLMs / Linearization
  ☆62Updated 6 months ago
• mnoukhov / async_rlhf
  Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models
  ☆68Updated 8 months ago
• linxihui / dkernel
  ☆21Updated 8 months ago
• VITA-Group / WeLore
  [ICML 2025] From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories and Applications
  ☆52Updated 2 months ago
• RLsys-Foundation / TritonForge
  🔥 LLM-powered GPU kernel synthesis: Train models to convert PyTorch ops into optimized Triton kernels via SFT+RL. Multi-turn compilation…
  ☆110Updated 2 months ago
• ArminAzizi98 / LaMDA
  ☆15Updated last year
• sail-sg / LongSpec
  LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification
  ☆72Updated 5 months ago
• sustcsonglin / linear-attention-and-beyond-slides
  ☆102Updated 10 months ago
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆90Updated 5 months ago