Alternatives and similar repositories for KVzip

Users that are interested in KVzip are comparing it to the libraries listed below

• DeepAuto-AI / hip-attention
  Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
  ☆148Updated last month
• SalesforceAIResearch / GemFilter
  ☆85Updated last month
• NVlabs / QeRL
  QeRL enables RL for 32B LLMs on a single H100 GPU.
  ☆470Updated last month
• hao-ai-lab / Dynasor
  [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.
  ☆215Updated 6 months ago
• Infini-AI-Lab / Multiverse
  ☆108Updated 3 months ago
• ZihanWang314 / CoE
  Chain of Experts (CoE) enables communication between experts within Mixture-of-Experts (MoE) models
  ☆226Updated last month
• Cornell-RelaxML / yaqa-quantization
  ☆66Updated 6 months ago
• wdlctc / headinfer
  ☆63Updated 7 months ago
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆135Updated last year
• IST-DASLab / QuEST
  Work in progress.
  ☆75Updated last month
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆157Updated 8 months ago
• NVlabs / MaskLLM
  [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models
  ☆183Updated 11 months ago
• inclusionAI / dInfer
  dInfer: An Efficient Inference Framework for Diffusion Language Models
  ☆373Updated this week
• BaohaoLiao / RSD
  [ICML 2025] Reward-guided Speculative Decoding (RSD) for efficiency and effectiveness.
  ☆52Updated 7 months ago
• eqimp / hogwild_llm
  Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache
  ☆136Updated 4 months ago
• xichen-fy / Fira
  Fira: Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint?
  ☆119Updated last year
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆162Updated 8 months ago
• VITA-Group / WeLore
  [ICML 2025] From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories and Applications
  ☆52Updated last month
• Cornell-RelaxML / qtip
  ☆159Updated 6 months ago
• hetailang / SqueezeAttention
  ☆38Updated last year
• IST-DASLab / Quartet
  ☆113Updated last month
• thu-nics / MoA
  [CoLM'25] The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>
  ☆154Updated last month
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆37Updated 2 months ago
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆35Updated 9 months ago
• FasterDecoding / BitDelta
  ☆204Updated last year
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆198Updated 3 weeks ago
• s-sahoo / Eso-LMs
  Esoteric Language Models
  ☆108Updated last month
• jiwonsong-dev / SLEB
  [ICML 2024] Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks
  ☆38Updated 10 months ago
• Multiverse4FM / Multiverse
  ☆89Updated 6 months ago
• tilde-research / nsa-impl
  An efficient implementation of the NSA (Native Sparse Attention) kernel
  ☆126Updated 6 months ago