Alternatives and similar repositories for SparseProgressiveDistillation

Users that are interested in SparseProgressiveDistillation are comparing it to the libraries listed below

• kssteven418 / BigLittleDecoder
  [NeurIPS'23] Speculative Decoding with Big Little Decoder
  ☆92Updated last year
• harveyp123 / LinGCN-Neurips23
  Official Implementation of "LinGCN: Structural Linearized Graph Convolutional Network for Homomorphically Encrypted Inference"
  ☆25Updated last year
• ChandlerGuan / Transkimmer
  Code for ACL2022 publication Transkimmer: Transformer Learns to Layer-wise Skim
  ☆21Updated 2 years ago
• haizhongzheng / LTE
  ☆10Updated 8 months ago
• kssteven418 / SqueezeLLM-gradients
  ☆20Updated last year
• QingruZhang / PLATON
  This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).
  ☆46Updated 2 years ago
• falcon-xu / early-exit-papers
  A curated list of early exiting (LLM, CV, NLP, etc)
  ☆55Updated 10 months ago
• henryzhongsc / longctx_bench
  Official implementation for Yuan & Liu & Zhong et al., KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark o…
  ☆79Updated 4 months ago
• ZhengaoLi / DISP-LLM-Dimension-Independent-Structural-Pruning
  An implementation of the DISP-LLM method from the NeurIPS 2024 paper: Dimension-Independent Structural Pruning for Large Language Models.
  ☆20Updated 2 months ago
• harveyp123 / AutoReP
  Automatic ReLU Reduction
  ☆15Updated last year
• Adaxry / Unified_Layer_Skipping
  ☆14Updated last year
• kssteven418 / LTP
  [KDD'22] Learned Token Pruning for Transformers
  ☆98Updated 2 years ago
• hmarkc / parallel-prompt-decoding
  Efficient LLM Inference Acceleration using Prompting
  ☆48Updated 8 months ago
• DerrickYLJ / TidalDecode
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆39Updated 2 months ago
• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆60Updated 9 months ago
• cornell-zhang / llm-datatypes
  Codebase for ICML'24 paper: Learning from Students: Applying t-Distributions to Explore Accurate and Efficient Formats for LLMs
  ☆26Updated last year
• SqueezeAILab / SqueezedAttention
  SQUEEZED ATTENTION: Accelerating Long Prompt LLM Inference
  ☆48Updated 7 months ago
• zirui-ray-liu / Exact
  ☆21Updated 3 years ago
• graphcore-research / llm-inference-research
  An experimentation platform for LLM inference optimisation
  ☆31Updated 9 months ago
• wimh966 / outlier_suppression
  The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…
  ☆47Updated 2 years ago
• SNU-ARC / any-precision-llm
  [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs
  ☆108Updated 2 months ago
• VITA-Group / Q-Hitter
  ☆14Updated last year
• yxli2123 / LoSparse
  ☆57Updated last year
• zhangsichengsjtu / AFPQ
  AFPQ code implementation
  ☆21Updated last year
• hdong920 / LESS
  ☆50Updated last year
• mutonix / pyramidinfer
  ☆42Updated 7 months ago
• fmfi-compbio / admm-pruning
  ☆28Updated 11 months ago
• liyunqianggyn / Awesome-LLMs-Pruning
  Awesome LLM pruning papers all-in-one repository with integrating all useful resources and insights.
  ☆93Updated 6 months ago
• CASIA-IVA-Lab / FLAP
  [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models
  ☆55Updated last year
• BaiTheBest / SparseLLM
  Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)
  ☆62Updated 3 months ago