Alternatives and similar repositories for speculative_mamba

Users that are interested in speculative_mamba are comparing it to the libraries listed below

• TUDa-HWAI / Basis_Sharing
  ☆10Updated 9 months ago
• thu-ml / Adaptive-Sparse-Trainer
  Official implementation for "Pruning Large Language Models with Semi-Structural Adaptive Sparse Training" (AAAI 2025)
  ☆12Updated 2 weeks ago
• krafton-ai / lexico
  KV cache compression via sparse coding
  ☆11Updated 2 months ago
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆113Updated 7 months ago
• enyac-group / Quamba
  The official repository of Quamba1 [ICLR 2025] & Quamba2 [ICML 2025]
  ☆51Updated 3 weeks ago
• xiayuqing0622 / flex_head_fa
  Fast and memory-efficient exact attention
  ☆68Updated 4 months ago
• rhubarbwu / neural-collapse
  Generic library for neural collapse and several derivative works on the phenomenon.
  ☆12Updated 3 months ago
• IST-DASLab / QuEST
  Work in progress.
  ☆70Updated 2 weeks ago
• PiotrNawrot / sparse-frontier
  The evaluation framework for training-free sparse attention in LLMs
  ☆82Updated 3 weeks ago
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆222Updated 2 months ago
• ScalingIntelligence / CATS
  ☆26Updated 8 months ago
• ACA-Lab-SJTU / token-ring
  ☆10Updated 6 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆128Updated 7 months ago
• tilde-research / nsa-impl
  An efficient implementation of the NSA (Native Sparse Attention) kernel
  ☆89Updated 3 weeks ago
• insuhan / hyper-attn
  ☆81Updated last year
• selfsupervised-ai / Natural-GaLore
  An extention to the GaLore paper, to perform Natural Gradient Descent in low rank subspace
  ☆17Updated 8 months ago
• NX-AI / flashrnn
  FlashRNN - Fast RNN Kernels with I/O Awareness
  ☆92Updated last month
• jiwonsong-dev / SLEB
  Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks
  ☆36Updated 5 months ago
• thu-nics / MoA
  [CoLM'25] The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>
  ☆139Updated this week
• HanGuo97 / log-linear-attention
  ☆222Updated last month
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆78Updated last month
• FasterDecoding / TEAL
  ☆136Updated 5 months ago
• IST-DASLab / MicroAdam
  This repository contains code for the MicroAdam paper.
  ☆20Updated 7 months ago
• ambisinister / mla-experiments
  Experiments on Multi-Head Latent Attention
  ☆93Updated 10 months ago
• NVIDIA / ngpt
  Normalized Transformer (nGPT)
  ☆184Updated 7 months ago
• Dao-AILab / grouped-latent-attention
  ☆116Updated last month
• shawntan / scattermoe
  Triton-based implementation of Sparse Mixture of Experts.
  ☆224Updated 7 months ago
• SNU-ARC / any-precision-llm
  [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs
  ☆111Updated last week
• mit-han-lab / x-attention
  [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring
  ☆191Updated last week
• CASE-Lab-UMD / Unified-MoE-Compression
  The official implementation of the paper "Towards Efficient Mixture of Experts: A Holistic Study of Compression Techniques (TMLR)".
  ☆71Updated 3 months ago