Official Implementation for [ICLR26] DefensiveKV: Taming the Fragility of KV Cache Eviction in LLM Inference
☆61Mar 28, 2026Updated 7 months ago
Alternatives and similar repositories for DefensiveKV
Users that are interested in DefensiveKV are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The Official Implementation of Ada-KV [NeurIPS 2025]☆143Nov 26, 2025Updated 11 months ago
- ☆39Mar 17, 2025Updated last year
- [ICML 2025] RocketKV: Accelerating Long-Context LLM Inference via Two-Stage KV Cache Compression☆55Aug 7, 2025Updated last year
- [ICLR 2026] Draft-based Approximate Inference for LLMs☆24Mar 10, 2026Updated 7 months ago
- ☆17Jun 25, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆14Sep 7, 2024Updated 2 years ago
- LLM KV cache compression made easy☆1,241Updated this week
- ☆30Sep 11, 2026Updated last month
- A sparse-first inference engine (SparseEngine).☆106Updated this week
- Implementation of the paper "ProxyAttn: Guided Sparse Attention via Representative Heads".☆14Mar 9, 2026Updated 7 months ago
- ☆336Jul 10, 2025Updated last year
- [ACL 2026] Enabling Efficient Reasoning in LLMs via Black-box Persuasive Prompting☆23Jan 9, 2026Updated 9 months ago
- ☆20Jun 30, 2025Updated last year
- Scripts and code relating to building anatomical templates.☆11Aug 14, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [ICLR 2025🔥] D2O: Dynamic Discriminative Operations for Efficient Long-Context Inference of Large Language Models☆27Jul 7, 2025Updated last year
- ☆12Jun 6, 2026Updated 4 months ago
- ☆14Dec 12, 2024Updated last year
- [ICLR 2026] LookaheadKV: Fast and Accurate KV Cache Eviction by Glimpsing into the Future without Generation☆14Mar 16, 2026Updated 7 months ago
- [ICML 2024]: Transformer Sub-Layers Deserve Differentiated Structured Compression for Large Language Models☆11May 19, 2024Updated 2 years ago
- The code and data for the paper "Lost-in-the-Middle in Long-Text Generation: Synthetic Dataset, Evaluation Framework, and Mitigation"☆15Oct 8, 2025Updated last year
- 📰 Must-read papers on KV Cache Compression (constantly updating 🤗).☆748Aug 16, 2026Updated 2 months ago
- KV cache compression for high-throughput LLM inference☆163Feb 5, 2025Updated last year
- DATAVIEW is a big data workflow management system. It uses Dropbox as the data cloud and Amazon EC2 as the compute cloud. Current researc…☆11Oct 22, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Dynamic Context Selection for Efficient Long-Context LLMs☆65May 20, 2025Updated last year
- 🔥 [ICML'26] ParisKV: Fast and Drift-Robust KV-Cache Retrieval for Long-Context LLMs☆37Aug 14, 2026Updated 2 months ago
- [ICLR 2026] Mixing Importance with Diversity: Joint Optimization for KV Cache Compression in Large Vision-Language Models☆31Mar 21, 2026Updated 7 months ago
- PAROAttn based on SAGEAttn☆11Nov 30, 2025Updated 11 months ago
- Deep Learning Analysis of Defect and Phase Evolution During Electron Beam Induced Transformations in WS2☆13Aug 14, 2018Updated 8 years ago
- Accurate and fast KV cache compression with a gating mechanism☆33Jul 27, 2026Updated 3 months ago
- ThinK: Thinner Key Cache by Query-Driven Pruning☆30Jun 2, 2026Updated 4 months ago
- PyTorch implementation of Language model compression with weighted low-rank factorization☆14Jun 28, 2023Updated 3 years ago
- Protein Pocket Detection with Geometry Features and Hierarchy.☆11May 29, 2018Updated 8 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆38Oct 4, 2025Updated last year
- [NeurIPS'25 Spotlight] Adaptive Attention Sparsity with Hierarchical Top-p Pruning☆110Aug 31, 2026Updated 2 months ago
- ☆17Aug 25, 2026Updated 2 months ago
- [ICML 2025 Spotlight] RAPID: Long-Context Inference with Retrieval-Augmented Speculative Decoding☆23Mar 2, 2025Updated last year
- Evaluation code for the EMNLP 2024 Findings paper introducing LongGenBench, a benchmark for long-context generation by large language mod…☆25Oct 8, 2024Updated 2 years ago
- MobiSys#114☆23Aug 17, 2023Updated 3 years ago
- MEMORY CENTRIC SYSTEMS FOR AI(CSI6207-01) Lecture at Yonsei(20-1)☆12Apr 6, 2022Updated 4 years ago