Alternatives and similar repositories for TokenButler

Users that are interested in TokenButler are comparing it to the libraries listed below

• qiuzh20 / gated_attention
  The official implementation for Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
  ☆46Updated 2 months ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆38Updated 9 months ago
• OpenSparseLLMs / MoM
  ☆95Updated 3 months ago
• hdong920 / GRIFFIN
  ☆38Updated 11 months ago
• ldery / Bonsai
  Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"
  ☆28Updated last year
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆53Updated 2 years ago
• sail-sg / LongSpec
  LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification
  ☆61Updated 3 weeks ago
• SqueezeAILab / SqueezedAttention
  SQUEEZED ATTENTION: Accelerating Long Prompt LLM Inference
  ☆50Updated 8 months ago
• SempraETY / Pruning-via-Merging
  ☆20Updated 8 months ago
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆92Updated last week
• htqin / IR-QLoRA
  [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…
  ☆67Updated last year
• Infini-AI-Lab / Kinetics
  Kinetics: Rethinking Test-Time Scaling Laws
  ☆70Updated 3 weeks ago
• OpenSparseLLMs / Linearization
  ☆54Updated 3 weeks ago
• pprp / Pruner-Zero
  [ICML24] Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs
  ☆91Updated 8 months ago
• Lucky-Lance / SPP
  [ICML 2024] SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
  ☆21Updated last year
• AkideLiu / MiniCache
  ☆10Updated 11 months ago
• Jingyu6 / speculative_prefill
  ☆37Updated 2 months ago
• BaiTheBest / SparseLLM
  Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)
  ☆64Updated 4 months ago
• OpenSparseLLMs / Linear-MoE
  ☆113Updated 2 months ago
• hdong920 / LESS
  ☆50Updated last year
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆52Updated 5 months ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆58Updated 10 months ago
• CASE-Lab-UMD / Unified-MoE-Compression
  The official implementation of the paper "Towards Efficient Mixture of Experts: A Holistic Study of Compression Techniques (TMLR)".
  ☆72Updated 4 months ago
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆49Updated 9 months ago
• hahnyuan / ASVD4LLM
  Activation-aware Singular Value Decomposition for Compressing Large Language Models
  ☆74Updated 9 months ago
• uservan / ThinkPO
  ☆18Updated this week
• ArminAzizi98 / LaMDA
  ☆15Updated 8 months ago
• UCSB-NLP-Chang / ThinkPrune
  ☆39Updated 3 months ago
• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆61Updated 10 months ago
• sail-sg / SimLayerKV
  The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.
  ☆48Updated 9 months ago