[MLSys 2026] Official code of SkipKV: Selectively Skip KV Generation and Storage for Efficient Inference with Large Reasoning Models.
☆16Oct 26, 2026Updated 3 weeks ago
Alternatives and similar repositories for SkipKV
Users that are interested in SkipKV are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Nov 7, 2024Updated 2 years ago
- ☆13May 13, 2022Updated 4 years ago
- Activation-Steered Compression☆18Jan 30, 2026Updated 9 months ago
- Codebase for layer wise N:M pruning pattern assignment for LLMs☆16Aug 5, 2025Updated last year
- [ECCV 2024] CLAMP-ViT: Contrastive Data-Free Learning for Adaptive Post-Training Quantization of ViTs☆20Jul 2, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Official Implementation of LANTERN (ICLR'25) and LANTERN++(ICLRW-SCOPE'25)☆22Mar 5, 2025Updated last year
- [COLM 2025] SEAL: Steerable Reasoning Calibration of Large Language Models for Free☆65Apr 6, 2025Updated last year
- The official code implementation for paper "PM-KVQ: Progressive Mixed-precision KV Cache Quantization for Long-CoT LLMs"☆33May 24, 2025Updated last year
- A comprehensive, enterprise-ready toolkit for deploying Agentic AI systems on Intel® Xeon processors and Intel accelerators. Built for or…☆54Updated this week
- GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM☆186Jul 12, 2024Updated 2 years ago
- ☆12Jun 2, 2026Updated 5 months ago
- ☆14Sep 7, 2024Updated 2 years ago
- [NAACL 24 Oral] LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models☆40Jan 9, 2025Updated last year
- Are gradient information useful for pruning of LLMs?☆48Aug 23, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆17Jun 25, 2024Updated 2 years ago
- Block-GTQ: RoPE-aware bit allocation for KV-cache quantization☆17Oct 29, 2026Updated 2 weeks ago
- Models Take Notes at Prefill: KV Cache Can Be Editable and Composable (arXiv:2606.17107) — paper, code, results, and interactive companio…☆17Nov 9, 2026Updated last week
- Official implementation of "SentenceKV: Efficient LLM Inference via Sentence-Level Semantic KV Caching" (COLM 2025). A novel KV cache com…☆15Sep 29, 2025Updated last year
- Robodyno Python Library.☆12Jun 1, 2026Updated 5 months ago
- [ICML'26] Towards Feedback-to-Plan Decisions for Self-Evolving LLM Agents in CUDA Kernel Generation☆13Sep 9, 2026Updated 2 months ago
- [ICML'26] RaBitQCache: Rotated Binary Quantization for KVCache in Long Context LLM Inference☆16Sep 14, 2026Updated 2 months ago
- Official implementation of STaR-KV: training-free spatio-temporal KV cache compression for efficient GUI vision-language models.☆22Oct 17, 2026Updated last month
- ☆20Jun 30, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆25Nov 11, 2026Updated last week
- [EMNLP 2025 Main Conference] Mitigating Hallucinations in Vision-Language Models through Image-Guided Head Suppression☆17Dec 26, 2025Updated 10 months ago
- ☆19Aug 16, 2025Updated last year
- An automated script for GPT and SQL☆11Feb 14, 2024Updated 2 years ago
- Artifact for Oaken: Fast and Efficient LLM Serving with Online-Offline Hybrid KV Cache Quantization☆20May 9, 2025Updated last year
- ☆18Sep 6, 2024Updated 2 years ago
- ☆24Updated this week
- ☆15May 12, 2023Updated 3 years ago
- Waterwheel is a distributed append-only store supporting millions insertions per second and realtime temporal and key range query☆14Jan 23, 2019Updated 7 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- encouRAGe lib for evaluating RAG☆19May 25, 2026Updated 5 months ago
- [ICML 2025] CommVQ: Commutative Vector Quantization for KV Cache Compression☆27Sep 2, 2025Updated last year
- Code associated with the paper "Prior Image-Constrained Reconstruction using Style-Based Generative Models" accepted to ICML 2021.☆11Jun 14, 2021Updated 5 years ago
- NanoDet for Jetson Nano☆11Sep 30, 2023Updated 3 years ago
- Code for Research Project TLDR☆26Jul 28, 2025Updated last year
- ☆31Sep 11, 2026Updated 2 months ago
- ☆11Feb 26, 2026Updated 8 months ago
Are these results useful?