Alternatives and similar repositories for DeSCo

Users that are interested in DeSCo are comparing it to the libraries listed below

• tsinghua-ideal / Twilight
  [NeurIPS'25 Spotlight] Adaptive Attention Sparsity with Hierarchical Top-p Pruning
  ☆87Updated 2 months ago
• thu-nics / qllm-eval
  Code Repository of Evaluating Quantized Large Language Models
  ☆136Updated last year
• PanZaifeng / FastTree-Artifact
  ☆27Updated 10 months ago
• pku-liang / ArkVale
  ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)
  ☆52Updated last year
• mit-han-lab / Quest
  [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
  ☆370Updated 6 months ago
• shadowpa0327 / Palu
  [ICLR 2025] Palu: Compressing KV-Cache with Low-Rank Projection
  ☆153Updated 11 months ago
• infinigence / SpecEE
  Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)
  ☆70Updated 9 months ago
• wangqinsi1 / Dobi-SVD
  Official code implementation for 2025 ICLR accepted paper "Dobi-SVD : Differentiable SVD for LLM Compression and Some New Perspectives"
  ☆50Updated 3 months ago
• microsoft / SeerAttention
  SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
  ☆188Updated 4 months ago
• andy-yang-1 / DoubleSparse
  16-fold memory access reduction with nearly no loss
  ☆109Updated 10 months ago
• thu-ml / Jetfire-INT8Training
  ☆60Updated last year
• SNU-ARC / any-precision-llm
  [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs
  ☆123Updated 6 months ago
• Hsu1023 / DuQuant
  [NeurIPS 2024 Oral🔥] DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs.
  ☆180Updated last year
• TreeAI-Lab / Awesome-KV-Cache-Management
  This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…
  ☆278Updated last month
• snu-comparch / InfiniGen
  InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
  ☆174Updated last year
• imagination-research / EEP
  Efficient Expert Pruning for Sparse Mixture-of-Experts Language Models: Enhancing Performance and Reducing Inference Costs
  ☆22Updated 2 months ago
• LiuXiaoxuanPKU / GACT-ICML
  ☆43Updated 3 years ago
• MoE-Inf / awesome-moe-inference
  Curated collection of papers in MoE model inference
  ☆339Updated 3 months ago
• Supercomputing-System-AI-Lab / MiLo
  Code repo for efficient quantized MoE inference with mixture of low-rank compensators
  ☆29Updated 9 months ago
• Aaronhuang-778 / SliM-LLM
  [ICML 2025] SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Models
  ☆49Updated last year
• goliaro / specinfer-ae
  ☆26Updated last year
• attention-survey / Efficient_Attention_Survey
  A Survey of Efficient Attention Methods: Hardware-efficient, Sparse, Compact, and Linear Attention
  ☆278Updated 2 months ago
• OpenBitSys / BitDecoding
  [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.
  ☆79Updated last month
• d-matrix-ai / keyformer-llm
  Keyformer proposes KV Cache reduction through key tokens identification and without the need for fine-tuning
  ☆59Updated last year
• microsoft / SparTA
  ☆164Updated last year
• clevercool / ANT-Quantization
  ☆113Updated 2 years ago
• sspec-project / SparseSpec
  Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding
  ☆82Updated 2 months ago
• hahnyuan / ASVD4LLM
  Activation-aware Singular Value Decomposition for Compressing Large Language Models
  ☆84Updated last year
• HPMLL / SpInfer_EuroSys25
  ☆31Updated 10 months ago
• yuezhouhu / 2by4-pretrain
  Efficient 2:4 sparse training algorithms and implementations
  ☆58Updated last year