Alternatives and similar repositories for KVzip

Users that are interested in KVzip are comparing it to the libraries listed below

• z-lab / dflash
  Block Diffusion for Ultra-Fast Speculative Decoding
  ☆313Updated last week
• DeepAuto-AI / hip-attention
  Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
  ☆147Updated 2 months ago
• inclusionAI / dInfer
  dInfer: An Efficient Inference Framework for Diffusion Language Models
  ☆389Updated last week
• SalesforceAIResearch / GemFilter
  ☆85Updated 2 months ago
• ZihanWang314 / CoE
  Chain of Experts (CoE) enables communication between experts within Mixture-of-Experts (MoE) models
  ☆226Updated 2 months ago
• NVlabs / QeRL
  QeRL enables RL for 32B LLMs on a single H100 GPU.
  ☆473Updated last month
• wdlctc / headinfer
  ☆63Updated 8 months ago
• Infini-AI-Lab / Multiverse
  ☆109Updated 4 months ago
• Multiverse4FM / Multiverse
  ☆90Updated 7 months ago
• hao-ai-lab / Dynasor
  [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.
  ☆217Updated 7 months ago
• xichen-fy / Fira
  Fira: Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint?
  ☆119Updated last year
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆198Updated last month
• Cornell-RelaxML / yaqa-quantization
  ☆69Updated 6 months ago
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆148Updated 11 months ago
• inclusionAI / Ring-V2
  Ring-V2 is a reasoning MoE LLM provided and open-sourced by InclusionAI.
  ☆89Updated 2 months ago
• inclusionAI / dFactory
  Easy and Efficient dLLM Fine-Tuning
  ☆194Updated last month
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆136Updated last year
• NVlabs / MaskLLM
  [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models
  ☆183Updated last year
• thu-nics / MoA
  [CoLM'25] The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>
  ☆153Updated this week
• inclusionAI / Ling-V2
  Ling-V2 is a MoE LLM provided and open-sourced by InclusionAI.
  ☆251Updated 3 months ago
• QwenLM / ParScale
  Parallel Scaling Law for Language Model — Beyond Parameter and Inference Time Scaling
  ☆467Updated 8 months ago
• Cornell-RelaxML / qtip
  ☆163Updated 6 months ago
• NVIDIA / Star-Attention
  Efficient LLM Inference over Long Sequences
  ☆393Updated 6 months ago
• OpenGVLab / EfficientQAT
  [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆326Updated last month
• BaohaoLiao / RSD
  [ICML 2025] Reward-guided Speculative Decoding (RSD) for efficiency and effectiveness.
  ☆53Updated 8 months ago
• bigai-nlco / TokenSwift
  [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation
  ☆120Updated 7 months ago
• eqimp / hogwild_llm
  Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache
  ☆139Updated 5 months ago
• VITA-Group / WeLore
  [ICML 2025] From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories and Applications
  ☆52Updated 2 months ago
• Tencent / llm.hunyuan.T1
  ☆84Updated 9 months ago
• hetailang / SqueezeAttention
  ☆38Updated last year