xKV: Cross-Layer SVD for KV-Cache Compression [ICML 2026]
☆60Jul 7, 2026Updated 3 months ago
Alternatives and similar repositories for xKV
Users that are interested in xKV are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2025] Speculate Deep and Accurate☆25Aug 10, 2026Updated 2 months ago
- UniQL official repository (ICLR 2026)☆19Jan 27, 2026Updated 9 months ago
- ☆27May 12, 2026Updated 5 months ago
- ☆47Nov 25, 2024Updated last year
- [ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache☆438Nov 20, 2025Updated 11 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- The official repository of Quamba1 [ICLR 2025] & Quamba2 [ICML 2025]☆70Jun 19, 2025Updated last year
- The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.☆55Oct 18, 2024Updated 2 years ago
- Sequential Monte Carlo Speculative Decoding☆54Aug 25, 2026Updated 2 months ago
- [ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference☆316May 1, 2025Updated last year
- ☆15Apr 11, 2024Updated 2 years ago
- [COLM 2024] SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models☆25Oct 5, 2024Updated 2 years ago
- The official implementation of "LightTransfer: Your Long-Context LLM is Secretly a Hybrid Model with Effortless Adaptation"☆22Apr 22, 2025Updated last year
- Implementation of "RaanA: A Fast, Flexible, and Data-Efficient Post-Training Quantization Algorithm"☆18Apr 11, 2025Updated last year
- Code for the paper "Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns"☆19Mar 15, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆14Sep 7, 2024Updated 2 years ago
- ☆13Jun 16, 2021Updated 5 years ago
- Algorithms for approximate attention in LLMs☆23Apr 14, 2025Updated last year
- (ACL2025 oral) SCOPE: Optimizing KV Cache Compression in Long-context Generation☆37May 28, 2025Updated last year
- [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding☆280Aug 31, 2024Updated 2 years ago
- ☆23Aug 24, 2026Updated 2 months ago
- [ICML 2025] CommVQ: Commutative Vector Quantization for KV Cache Compression☆27Sep 2, 2025Updated last year
- Source Code for our ICLR'26 paper☆18Feb 22, 2026Updated 8 months ago
- Adamas: Hadamard Sparse Attention for Efficient Long-context Inference☆15Oct 1, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 📰 Must-read papers on KV Cache Compression (constantly updating 🤗).☆750Aug 16, 2026Updated 2 months ago
- Repo for ECHO: Efficient KV Cache Offloading with Lossless Prefetching for Serving Native Sparse Attention LLMs (OSDI'26)☆42Jul 12, 2026Updated 3 months ago
- [ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2☆309Aug 28, 2025Updated last year
- CLIPPER: Compression enables long-context synthetic data generation [COLM '25]☆11Apr 16, 2025Updated last year
- Multi-Layer Key-Value sharing experiments on Pythia models☆35Jun 14, 2024Updated 2 years ago
- ☆25Jul 23, 2026Updated 3 months ago
- [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs☆137Oct 13, 2026Updated 3 weeks ago
- ☆16Jun 14, 2024Updated 2 years ago
- LLM KV cache compression made easy☆1,245Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [ICLR 2026] The official implementation of "PTQ4ARVG: Post-Training Quantization for AutoRegressive Visual Generation Models"☆18Feb 3, 2026Updated 9 months ago
- [CVPR 2026 Oral] SenCache: Accelerating Diffusion Model Inference via Sensitivity-Aware Caching☆30Jun 5, 2026Updated 5 months ago
- The training codes of Jasper-Token-Compression-600M☆22Nov 19, 2025Updated 11 months ago
- ☆12Dec 24, 2025Updated 10 months ago
- ☆11Mar 4, 2025Updated last year
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆57Aug 6, 2025Updated last year
- [ICLR 2025] Dobi-SVD : Differentiable SVD for LLM Compression and Some New Perspectives"☆55Oct 19, 2025Updated last year