Alternatives and similar repositories for DeSCo

Users that are interested in DeSCo are comparing it to the libraries listed below

• thu-nics / qllm-eval
  Code Repository of Evaluating Quantized Large Language Models
  ☆136Updated last year
• tsinghua-ideal / Twilight
  [NeurIPS'25 Spotlight] Adaptive Attention Sparsity with Hierarchical Top-p Pruning
  ☆83Updated last month
• PanZaifeng / FastTree-Artifact
  ☆27Updated 9 months ago
• microsoft / SeerAttention
  SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
  ☆184Updated 3 months ago
• mit-han-lab / Quest
  [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
  ☆362Updated 6 months ago
• wangqinsi1 / Dobi-SVD
  Official code implementation for 2025 ICLR accepted paper "Dobi-SVD : Differentiable SVD for LLM Compression and Some New Perspectives"
  ☆50Updated 2 months ago
• Aaronhuang-778 / SliM-LLM
  [ICML 2025] SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Models
  ☆47Updated last year
• pku-liang / ArkVale
  ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)
  ☆50Updated last year
• andy-yang-1 / DoubleSparse
  16-fold memory access reduction with nearly no loss
  ☆109Updated 9 months ago
• infinigence / SpecEE
  Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)
  ☆70Updated 8 months ago
• thu-nics / MBQ
  The code repository of "MBQ: Modality-Balanced Quantization for Large Vision-Language Models"
  ☆73Updated 9 months ago
• thu-ml / Jetfire-INT8Training
  ☆60Updated last year
• cornell-zhang / llm-datatypes
  Codebase for ICML'24 paper: Learning from Students: Applying t-Distributions to Explore Accurate and Efficient Formats for LLMs
  ☆27Updated last year
• clevercool / ANT-Quantization
  ☆113Updated 2 years ago
• SNU-ARC / any-precision-llm
  [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs
  ☆123Updated 6 months ago
• IST-DASLab / FP-Quant
  ☆91Updated last month
• snu-comparch / InfiniGen
  InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
  ☆170Updated last year
• mit-han-lab / fouroversix
  Code for the paper “Four Over Six: More Accurate NVFP4 Quantization with Adaptive Block Scaling”
  ☆104Updated last week
• TreeAI-Lab / Awesome-KV-Cache-Management
  This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…
  ☆264Updated last month
• Hsu1023 / DuQuant
  [NeurIPS 2024 Oral🔥] DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs.
  ☆178Updated last year
• shadowpa0327 / Palu
  [ICLR 2025] Palu: Compressing KV-Cache with Low-Rank Projection
  ☆151Updated 10 months ago
• thu-nics / CLAP-triangle-counting
  [DATE'23] The official code for paper <CLAP: Locality Aware and Parallel Triangle Counting with Content Addressable Memory>
  ☆23Updated last month
• HPMLL / SpInfer_EuroSys25
  ☆31Updated 9 months ago
• mit-han-lab / Block-Sparse-Attention
  A sparse attention kernel supporting mix sparse patterns
  ☆430Updated this week
• October2001 / Awesome-KV-Cache-Compression
  📰 Must-read papers on KV Cache Compression (constantly updating 🤗).
  ☆631Updated 3 months ago
• AboveParadise / LLMCBench
  ☆26Updated last year
• OpenBitSys / BitDecoding
  [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.
  ☆76Updated 3 weeks ago
• imagination-research / EEP
  Efficient Expert Pruning for Sparse Mixture-of-Experts Language Models: Enhancing Performance and Reducing Inference Costs
  ☆22Updated 2 months ago
• hgyhungry / ShflBW_Sparse_NN
  ☆16Updated 3 years ago
• zyxxmu / cam
  Pytorch implementation of our paper accepted by ICML 2024 -- CaM: Cache Merging for Memory-efficient LLMs Inference
  ☆47Updated last year