Alternatives and similar repositories for ZipCache:

Users that are interested in ZipCache are comparing it to the libraries listed below

• Hsu1023 / DuQuant
  [NeurIPS 2024 Oral🔥] DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs.
  ☆140Updated 4 months ago
• ModelTC / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆35Updated 11 months ago
• thu-nics / MBQ
  The code repository of "MBQ: Modality-Balanced Quantization for Large Vision-Language Models"
  ☆29Updated last month
• ChenMnZ / PrefixQuant
  An algorithm for static activation quantization of LLMs
  ☆115Updated 2 weeks ago
• ROIM1998 / APT
  [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  ☆34Updated 8 months ago
• thu-nics / ViDiT-Q
  [ICLR'25] ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation
  ☆55Updated last week
• Juanerx / Q-DiT
  PyTorch code for Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers
  ☆37Updated 5 months ago
• Aaronhuang-778 / Mixture-Compressor-MoE
  [ICLR 2025] Mixture Compressor for Mixture-of-Experts LLMs Gains More
  ☆34Updated last week
• ThisisBillhe / torch_quantizer
  torch_quantizer is a out-of-box quantization tool for PyTorch models on CUDA backend, specially optimized for Diffusion Models.
  ☆21Updated 10 months ago
• ThisisBillhe / ZipAR
  This is the official PyTorch implementation of "ZipAR: Accelerating Auto-regressive Image Generation through Spatial Locality"
  ☆45Updated last month
• htqin / IR-QLoRA
  [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…
  ☆60Updated 10 months ago
• cat538 / SKVQ
  SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models
  ☆15Updated 4 months ago
• thu-nics / DiTFastAttn
  ☆144Updated last month
• Shenyi-Z / ToCa
  Accelerating Diffusion Transformers with Token-wise Feature Caching
  ☆62Updated 2 weeks ago
• thu-nics / FrameFusion
  The official code implementation of paper "Combining Similarity and Importance for Video Token Reduction on Large Visual Language Models"
  ☆27Updated this week
• BaiTheBest / SparseLLM
  Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)
  ☆51Updated last week
• NVlabs / COAT
  ☆68Updated this week
• SUSTechBruce / LOOK-M
  [EMNLP 2024 Findings🔥] Official implementation of "LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Infe…
  ☆91Updated 3 months ago
• hahnyuan / ASVD4LLM
  Activation-aware Singular Value Decomposition for Compressing Large Language Models
  ☆56Updated 3 months ago
• Intelligent-Computing-Lab-Yale / TesseraQ
  ☆18Updated 3 months ago
• lzhxmu / VTW
  Code release for VTW (AAAI 2025) Oral
  ☆32Updated last month
• LINs-lab / DynMoE
  [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
  ☆70Updated last week
• Aaronhuang-778 / SliM-LLM
  SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Models
  ☆26Updated 6 months ago
• andy-yang-1 / DoubleSparse
  16-fold memory access reduction with nearly no loss
  ☆76Updated 3 months ago
• huyz2023 / 2by4-pretrain
  Efficient 2:4 sparse training algorithms and implementations
  ☆49Updated 2 months ago
• HuangOwen / RoLoRA
  [EMNLP 2024] RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization
  ☆31Updated 4 months ago
• mit-han-lab / Block-Sparse-Attention
  A sparse attention kernel supporting mix sparse patterns
  ☆133Updated last week
• SNU-ARC / any-precision-llm
  [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs
  ☆96Updated last month
• VITA-Group / llm-kick
  [ICLR 2024] Jaiswal, A., Gan, Z., Du, X., Zhang, B., Wang, Z., & Yang, Y. Compressing llms: The truth is rarely pure and never simple.
  ☆20Updated 11 months ago
• A-suozhang / ViDiT-Q
  ☆13Updated last week