Alternatives and similar repositories for ZipCache:

Users that are interested in ZipCache are comparing it to the libraries listed below

• thu-nics / ViDiT-Q
  [ICLR'25] ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation
  ☆59Updated 2 weeks ago
• Hsu1023 / DuQuant
  [NeurIPS 2024 Oral🔥] DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs.
  ☆144Updated 5 months ago
• ThisisBillhe / ZipAR
  This is the official PyTorch implementation of "ZipAR: Accelerating Auto-regressive Image Generation through Spatial Locality"
  ☆46Updated last month
• thu-nics / MBQ
  The code repository of "MBQ: Modality-Balanced Quantization for Large Vision-Language Models"
  ☆33Updated this week
• ROIM1998 / APT
  [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  ☆33Updated 9 months ago
• thu-nics / FrameFusion
  The official code implementation of paper "Combining Similarity and Importance for Video Token Reduction on Large Visual Language Models"
  ☆33Updated 3 weeks ago
• ModelTC / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆35Updated last year
• ChangyuanWang17 / QVLM
  [NeurIPS'24]Efficient and accurate memory saving method towards W4A4 large multi-modal models.
  ☆67Updated 2 months ago
• thu-nics / DiTFastAttn
  ☆149Updated last month
• xuyang-liu16 / Awesome-Token-Reduction-for-Model-Compression
  📚 Collection of token reduction for model compression resources.
  ☆44Updated 3 weeks ago
• Juanerx / Q-DiT
  [CVPR 2025] Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers
  ☆38Updated 6 months ago
• SUSTechBruce / LOOK-M
  [EMNLP 2024 Findings🔥] Official implementation of ": D2O: Dynamic Discriminative Operations for Efficient Long-Context Inference of Larg…
  ☆92Updated 4 months ago
• ThisisBillhe / EfficientDM
  [ICLR 2024 Spotlight] This is the official PyTorch implementation of "EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Di…
  ☆58Updated 9 months ago
• ThisisBillhe / torch_quantizer
  torch_quantizer is a out-of-box quantization tool for PyTorch models on CUDA backend, specially optimized for Diffusion Models.
  ☆21Updated 11 months ago
• ModelTC / TFMQ-DM
  [CVPR 2024 Highlight] This is the official PyTorch implementation of "TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Mo…
  ☆62Updated 7 months ago
• adreamwu / PTQ4DiT
  PyTorch implementation of PTQ4DiT https://arxiv.org/abs/2405.16005
  ☆25Updated 4 months ago
• ChenMnZ / PrefixQuant
  An algorithm for weight-activation quantization (W4A4, W4A8) of LLMs, supporting both static and dynamic quantization
  ☆118Updated last month
• Aaronhuang-778 / Mixture-Compressor-MoE
  [ICLR 2025] Mixture Compressor for Mixture-of-Experts LLMs Gains More
  ☆35Updated last month
• htqin / IR-QLoRA
  [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…
  ☆62Updated 10 months ago
• mit-han-lab / Block-Sparse-Attention
  A sparse attention kernel supporting mix sparse patterns
  ☆159Updated last month
• FFY0 / AdaKV
  The Official Implementation of Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inference
  ☆67Updated last month
• KD-TAO / DyCoke
  DyCoke: Dynamic Compression of Tokens for Fast Video Large Language Models
  ☆33Updated last week
• lzhxmu / VTW
  Code release for VTW (AAAI 2025) Oral
  ☆33Updated last month
• cat538 / SKVQ
  SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models
  ☆16Updated 5 months ago
• JinXins / Awesome-Token-Merge-for-MLLMs
  A paper list about Token Merge, Reduce, Resample, Drop for MLLMs.
  ☆37Updated 2 months ago
• LINs-lab / DynMoE
  [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
  ☆76Updated last month
• A-suozhang / Awesome-Efficient-Diffusion
  Curated list of methods that focuses on improving the efficiency of diffusion models
  ☆38Updated 8 months ago
• Theia-4869 / FasterVLM
  Official code for paper: [CLS] Attention is All You Need for Training-Free Visual Token Pruning: Make VLM Inference Faster.
  ☆52Updated 2 months ago
• NVlabs / COAT
  [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training
  ☆150Updated 2 weeks ago