Alternatives and similar repositories for KVzip

Users that are interested in KVzip are comparing it to the libraries listed below

• DeepAuto-AI / hip-attention
  Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
  ☆148Updated last month
• SalesforceAIResearch / GemFilter
  ☆85Updated 3 weeks ago
• hao-ai-lab / Dynasor
  [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.
  ☆209Updated 6 months ago
• wdlctc / headinfer
  ☆61Updated 6 months ago
• ZihanWang314 / CoE
  Chain of Experts (CoE) enables communication between experts within Mixture-of-Experts (MoE) models
  ☆223Updated last month
• Cornell-RelaxML / yaqa-quantization
  ☆64Updated 5 months ago
• BaohaoLiao / RSD
  [ICML 2025] Reward-guided Speculative Decoding (RSD) for efficiency and effectiveness.
  ☆52Updated 7 months ago
• IST-DASLab / QuEST
  Work in progress.
  ☆75Updated last week
• hetailang / SqueezeAttention
  ☆38Updated last year
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆145Updated 10 months ago
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆35Updated 8 months ago
• Infini-AI-Lab / Multiverse
  ☆104Updated 2 months ago
• Multiverse4FM / Multiverse
  ☆86Updated 5 months ago
• FasterDecoding / BitDelta
  ☆204Updated last year
• xichen-fy / Fira
  Fira: Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint?
  ☆118Updated last year
• Cornell-RelaxML / qtip
  ☆158Updated 5 months ago
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆132Updated last year
• VITA-Group / WeLore
  [ICML 2025] From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories and Applications
  ☆51Updated last month
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆37Updated last month
• OpenGVLab / EfficientQAT
  [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆316Updated last week
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆162Updated 7 months ago
• bigai-nlco / TokenSwift
  [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation
  ☆118Updated 6 months ago
• s-sahoo / Eso-LMs
  Esoteric Language Models
  ☆107Updated last week
• thu-nics / MoA
  [CoLM'25] The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>
  ☆151Updated last week
• wuhy68 / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks (EMNLP'24)
  ☆147Updated last year
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆110Updated last week
• eqimp / hogwild_llm
  Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache
  ☆135Updated 3 months ago
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆157Updated 7 months ago
• wdlctc / mini-s
  ☆53Updated last year
• NVlabs / MaskLLM
  [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models
  ☆181Updated 11 months ago