The official code implementation for paper "PM-KVQ: Progressive Mixed-precision KV Cache Quantization for Long-CoT LLMs"
☆33May 24, 2025Updated last year
Alternatives and similar repositories for PM-KVQ
Users that are interested in PM-KVQ are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Algorithm-System Co-design: accurate and efficient 2-bit KV cache quantization for LLM Inference.☆25May 20, 2026Updated 5 months ago
- [COLM 2024] SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models☆25Oct 5, 2024Updated 2 years ago
- [WSDM'24 Oral] The official implementation of paper <DeSCo: Towards Generalizable and Scalable Deep Subgraph Counting>☆24Mar 11, 2024Updated 2 years ago
- [DATE'23] The official code for paper <CLAP: Locality Aware and Parallel Triangle Counting with Content Addressable Memory>☆25Nov 2, 2026Updated 2 weeks ago
- [ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache☆441Nov 20, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆31Sep 11, 2026Updated 2 months ago
- [CoLM'25] The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>☆163Oct 9, 2026Updated last month
- Official implementation of "TailorKV: A Hybrid Framework for Long-Context Inference via Tailored KV Cache Optimization" (Findings of ACL …☆21Jul 25, 2025Updated last year
- [MLSys 2026] Official code of SkipKV: Selectively Skip KV Generation and Storage for Efficient Inference with Large Reasoning Models.☆16Oct 26, 2026Updated 3 weeks ago
- [ECCV24] MixDQ: Memory-Efficient Few-Step Text-to-Image Diffusion Models with Metric-Decoupled Mixed Precision Quantization☆50Nov 27, 2024Updated last year
- [ICML2025] KVTuner: Sensitivity-Aware Layer-wise Mixed Precision KV Cache Quantization for Efficient and Nearly Lossless LLM Inference☆32Jan 27, 2026Updated 9 months ago
- [NeurIPS'25] The official code implementation for paper "R2R: Efficiently Navigating Divergent Reasoning Paths with Small-Large Model Tok…☆109Oct 9, 2026Updated last month
- ☆26Oct 31, 2024Updated 2 years ago
- [ICCV'25] The official code of paper "Combining Similarity and Importance for Video Token Reduction on Large Visual Language Models"☆82Oct 9, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official implementation of "SentenceKV: Efficient LLM Inference via Sentence-Level Semantic KV Caching" (COLM 2025). A novel KV cache com…☆15Sep 29, 2025Updated last year
- The code repository of "MBQ: Modality-Balanced Quantization for Large Vision-Language Models"☆99Mar 17, 2025Updated last year
- [ICML 2025] CommVQ: Commutative Vector Quantization for KV Cache Compression☆27Sep 2, 2025Updated last year
- [NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization☆440Aug 13, 2024Updated 2 years ago
- ☆14Sep 7, 2024Updated 2 years ago
- ☆16Dec 9, 2023Updated 2 years ago
- ☆39Feb 12, 2025Updated last year
- offical repo for paper: ROTATED RUNTIME SMOOTH: TRAINING-FREE ACTIVATION SMOOTHER FOR ACCURATE INT4 INFERENCE☆12Oct 1, 2024Updated 2 years ago
- vision transformer; post-training quantization; model compression; ViT☆13Sep 1, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A minimal open-source on-policy-distillation implementation☆13May 21, 2026Updated 5 months ago
- [ICCV-2023] EMQ: Evolving Training-free Proxies for Automated Mixed Precision Quantization☆29Dec 6, 2023Updated 2 years ago
- codebase for Coruscant: Co-Designing GPU Kernel and Sparse Tensor Core to Advocate Unstructured Sparsity in Efficient LLM Inference☆11Oct 17, 2025Updated last year
- codebase for MUSTAFAR:Promoting Unstructured Sparsity for KV Pruning in LLM Inference☆12Nov 6, 2025Updated last year
- [COLM 2025] DFRot: Achieving Outlier-Free and Massive Activation-Free for Rotated LLMs with Refined Rotation; 知乎:https://zhuanlan.zhihu.c…☆30Mar 5, 2025Updated last year
- super-resolution; post-training quantization; model compression☆14Nov 10, 2023Updated 3 years ago
- [ICML 2025] RocketKV: Accelerating Long-Context LLM Inference via Two-Stage KV Cache Compression☆56Aug 7, 2025Updated last year
- Code Repository of Evaluating Quantized Large Language Models☆136Sep 8, 2024Updated 2 years ago
- AFPQ code implementation☆23Nov 6, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [EMNLP 2024] RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization☆40Sep 24, 2024Updated 2 years ago
- ☆28Nov 5, 2021Updated 5 years ago
- ☆39Updated this week
- Nsight Systems In Docker☆21Dec 21, 2023Updated 2 years ago
- [ICLR 2026] LookaheadKV: Fast and Accurate KV Cache Eviction by Glimpsing into the Future without Generation☆14Mar 16, 2026Updated 8 months ago
- [NeurIPS'26] The official code implementation for paper "TokenRouter: Efficient Serving System for Token-Level LLM Routing"☆79Oct 20, 2026Updated 3 weeks ago
- MicroMix: Efficient Mixed-Precision Quantization with Microscaling Formats for Large Language Models☆32Apr 2, 2026Updated 7 months ago
Are these results useful?