Alternatives and similar repositories for matrix-compressor

Users that are interested in matrix-compressor are comparing it to the libraries listed below

• hahnyuan / ASVD4LLM
  Activation-aware Singular Value Decomposition for Compressing Large Language Models
  ☆80Updated 11 months ago
• CASE-Lab-UMD / Unified-MoE-Compression
  The official implementation of the paper "Towards Efficient Mixture of Experts: A Holistic Study of Compression Techniques (TMLR)".
  ☆76Updated 6 months ago
• yxli2123 / LoSparse
  ☆60Updated last year
• SqueezeAILab / SqueezedAttention
  SQUEEZED ATTENTION: Accelerating Long Prompt LLM Inference
  ☆54Updated 10 months ago
• zyxxmu / cam
  Pytorch implementation of our paper accepted by ICML 2024 -- CaM: Cache Merging for Memory-efficient LLMs Inference
  ☆46Updated last year
• hdong920 / GRIFFIN
  ☆38Updated last year
• henryzhongsc / longctx_bench
  Official implementation for Yuan & Liu & Zhong et al., KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark o…
  ☆85Updated 7 months ago
• pan-x-c / EE-LLM
  EE-LLM is a framework for large-scale training and inference of early-exit (EE) large language models (LLMs).
  ☆68Updated last year
• VITA-Group / llm-kick
  [ICLR 2024] Jaiswal, A., Gan, Z., Du, X., Zhang, B., Wang, Z., & Yang, Y. Compressing llms: The truth is rarely pure and never simple.
  ☆24Updated 5 months ago
• IST-DASLab / EvoPress
  ☆33Updated 2 months ago
• BaiTheBest / SparseLLM
  Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)
  ☆66Updated 6 months ago
• PiotrNawrot / sparse-frontier
  The evaluation framework for training-free sparse attention in LLMs
  ☆100Updated 3 months ago
• opengear-project / GEAR
  GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM
  ☆168Updated last year
• FasterDecoding / TEAL
  ☆143Updated 7 months ago
• nil0x9 / flash-muon
  Flash-Muon: An Efficient Implementation of Muon Optimizer
  ☆189Updated 3 months ago
• Dao-AILab / grouped-latent-attention
  ☆129Updated 4 months ago
• yifanycc / loretta
  [NAACL 24 Oral] LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
  ☆36Updated 9 months ago
• ScalingIntelligence / CATS
  ☆29Updated 10 months ago
• xiayuqing0622 / flex_head_fa
  Fast and memory-efficient exact attention
  ☆70Updated 7 months ago
• insuhan / hyper-attn
  ☆83Updated last year
• Infini-AI-Lab / Kinetics
  Kinetics: Rethinking Test-Time Scaling Laws
  ☆80Updated 2 months ago
• zqOuO / GWT
  ☆13Updated 8 months ago
• shadowpa0327 / Palu
  [ICLR 2025] Palu: Compressing KV-Cache with Low-Rank Projection
  ☆142Updated 7 months ago
• Qualcomm-AI-research / llm-surgeon
  ☆33Updated last year
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆89Updated 2 months ago
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆119Updated 10 months ago
• cjyaras / deep-lora-transformers
  Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)
  ☆13Updated last year
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆34Updated 11 months ago
• DerrickYLJ / TidalDecode
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆47Updated 2 months ago
• Jingyu6 / speculative_prefill
  ☆43Updated 4 months ago