Alternatives and similar repositories for KVzip

Users that are interested in KVzip are comparing it to the libraries listed below

• DeepAuto-AI / hip-attention
  Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
  ☆148Updated last week
• SalesforceAIResearch / GemFilter
  ☆85Updated this week
• wdlctc / headinfer
  ☆60Updated 6 months ago
• ZihanWang314 / CoE
  Chain of Experts (CoE) enables communication between experts within Mixture-of-Experts (MoE) models
  ☆223Updated last week
• IST-DASLab / QuEST
  Work in progress.
  ☆75Updated 4 months ago
• BaohaoLiao / RSD
  [ICML 2025] Reward-guided Speculative Decoding (RSD) for efficiency and effectiveness.
  ☆50Updated 6 months ago
• Multiverse4FM / Multiverse
  ☆81Updated 5 months ago
• Infini-AI-Lab / Multiverse
  ☆101Updated 2 months ago
• inclusionAI / Ling-V2
  Ling-V2 is a MoE LLM provided and open-sourced by InclusionAI.
  ☆223Updated last month
• Cornell-RelaxML / yaqa-quantization
  ☆62Updated 4 months ago
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆143Updated 9 months ago
• hao-ai-lab / Dynasor
  [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.
  ☆203Updated 5 months ago
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆35Updated 8 months ago
• xichen-fy / Fira
  Fira: Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint?
  ☆115Updated last year
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆51Updated 2 weeks ago
• FasterDecoding / BitDelta
  ☆202Updated 11 months ago
• snu-mllab / Context-Memory
  Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)
  ☆62Updated last year
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆131Updated 11 months ago
• bigai-nlco / TokenSwift
  [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation
  ☆118Updated 5 months ago
• wuhy68 / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks (EMNLP'24)
  ☆147Updated last year
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆162Updated 7 months ago
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆156Updated 7 months ago
• hetailang / SqueezeAttention
  ☆38Updated last year
• NVlabs / QeRL
  QeRL enables RL for 32B LLMs on a single H100 GPU.
  ☆432Updated last month
• QwenLM / Self-Lengthen
  ☆92Updated last year
• OpenGVLab / EfficientQAT
  [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆308Updated 5 months ago
• efficientscaling / Z1
  [EMNLP'2025 Industry] Repo for "Z1: Efficient Test-time Scaling with Code"
  ☆66Updated 7 months ago
• NVlabs / MaskLLM
  [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models
  ☆179Updated 10 months ago
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆193Updated last month
• thu-nics / MoA
  [CoLM'25] The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>
  ☆150Updated 4 months ago