Alternatives and similar repositories for Slow-Fast-Sampling

Users that are interested in Slow-Fast-Sampling are comparing it to the libraries listed below

• MingyuJ666 / Rope_with_LLM
  [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…
  ☆80Updated 2 months ago
• OpenSparseLLMs / LLaMA-MoE-v2
  🚀 LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training
  ☆87Updated 9 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆119Updated last month
• LINs-lab / DynMoE
  [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
  ☆126Updated last month
• zyxxmu / DSnoT
  Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…
  ☆49Updated last year
• maomaocun / dLLM-cache
  Official PyTorch implementation of the paper "dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Caching" (dLLM-Cache…
  ☆143Updated 3 weeks ago
• yczhou001 / Awesome-Diffusion-LLM
  paper list, tutorial, and nano code snippet for Diffusion Large Language Models.
  ☆108Updated 2 months ago
• osehmathias / lisa
  LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning
  ☆35Updated last year
• OpenSparseLLMs / MoM
  ☆100Updated 4 months ago
• Lucky-Lance / SPP
  [ICML 2024] SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
  ☆21Updated last year
• UNITES-Lab / MC-SMoE
  [ICLR 2024 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"
  ☆93Updated 2 months ago
• Xingrun-Xing2 / EfficientLLM
  A family of efficient edge language models in 100M~1B sizes.
  ☆16Updated 6 months ago
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆85Updated 6 months ago
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆81Updated 2 months ago
• fscdc / Awesome-Efficient-Reasoning-Models
  [arXiv 2025] Efficient Reasoning Models: A Survey
  ☆259Updated last week
• GATECH-EIC / ACT
  [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…
  ☆42Updated last year
• machilusZ / FastGen
  This repo contains the source code for: Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs
  ☆39Updated last year
• yule-BUAA / MergeLLM
  Codes for Merging Large Language Models
  ☆33Updated last year
• hemingkx / TokenSkip
  [EMNLP 2025] TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆177Updated 2 months ago
• DreamLM / DreamOn
  Diffusion Language Models For Code Infilling Beyond Fixed-size Canvas
  ☆69Updated last month
• SalesforceAIResearch / ThinK
  ThinK: Thinner Key Cache by Query-Driven Pruning
  ☆23Updated 6 months ago
• OpenSparseLLMs / Linear-MoE
  ☆117Updated 3 months ago
• AkideLiu / MiniCache
  ☆10Updated 11 months ago
• SUSTechBruce / LOOK-M
  [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…
  ☆99Updated 9 months ago
• OpenSparseLLMs / Linearization
  ☆57Updated last month
• sail-sg / LongSpec
  LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification
  ☆63Updated last month
• sail-sg / LightTrans
  The official implementation of "LightTransfer: Your Long-Context LLM is Secretly a Hybrid Model with Effortless Adaptation"
  ☆20Updated 4 months ago
• DavidFanzz / SCMoE
  ☆26Updated last year
• hemingkx / SWIFT
  [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
  ☆53Updated 6 months ago
• ML-GSAI / Diffusion-LLM-Papers
  A Collection of Papers on Diffusion Language Models
  ☆119Updated last week