FreeKV: Boosting KV Cache Retrieval for Efficient LLM Inference (ICLR'26)
☆12Mar 5, 2026Updated 8 months ago
Alternatives and similar repositories for FreeKV
Users that are interested in FreeKV are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation for IceCache: Memory-Efficient KV-cache Management for Long-Sequence LLMs (ICLR 2026).☆25Jun 9, 2026Updated 5 months ago
- ClusterKV: Manipulating LLM KV Cache in Semantic Space for Recallable Compression (DAC'25)☆32Feb 26, 2026Updated 8 months ago
- Zipage is a high-concurrency LLM inference engine built on PagedAttention and KV cache eviction.☆15Mar 13, 2026Updated 7 months ago
- ☆39Mar 9, 2026Updated 8 months ago
- Adamas: Hadamard Sparse Attention for Efficient Long-context Inference☆15Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- TurboQuant reference implementation — KV cache compression with engineering insights (ICLR 2026 paper reproduction)☆17Mar 28, 2026Updated 7 months ago
- A list of multi-vector retrieval resources☆18May 29, 2024Updated 2 years ago
- Repo for ECHO: Efficient KV Cache Offloading with Lossless Prefetching for Serving Native Sparse Attention LLMs (OSDI'26)☆43Jul 12, 2026Updated 3 months ago
- Official repository for "SSA: Sparse Sparse Attention by Aligning Full and Sparse Attention Outputs in Feature Space"☆32May 7, 2026Updated 6 months ago
- ☆25Apr 6, 2026Updated 7 months ago
- [OSDI'25] QiMeng-Xpiler: Transcompiling Tensor Programs for Deep Learning Systems with a Neural-Symbolic Approach☆10Jun 20, 2025Updated last year
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 4 months ago
- Segmented Code Adjustment Quantization (SAQ)☆29Sep 22, 2025Updated last year
- ☆13Mar 27, 2026Updated 7 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- official code for GliDe with a CaPE☆21Aug 13, 2024Updated 2 years ago
- ☆15Updated this week
- Mechanistic uncertainty calibration of LLMs.☆14Jan 13, 2026Updated 9 months ago
- ☆13Jul 15, 2024Updated 2 years ago
- (COLING2025) SEED: Accelerating Reasoning Tree Construction via Scheduled Speculative Decoding☆10Dec 18, 2024Updated last year
- The code used to train and run inference with the ColQwen3 model. Welcome to follow and star! ⭐️⭐️⭐️ https://huggingface.co/goodman2001/…☆16Aug 16, 2026Updated 2 months ago
- This is an AAAI-2026 conference paper repo.☆18Mar 1, 2026Updated 8 months ago
- 🔥 [ICML'26] ParisKV: Fast and Drift-Robust KV-Cache Retrieval for Long-Context LLMs☆37Aug 14, 2026Updated 2 months ago
- ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)☆55Dec 17, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆14Jan 28, 2024Updated 2 years ago
- ☆22Apr 17, 2026Updated 6 months ago
- [ICCAD 2024] Software Simulation Framework for "PACiM: A Sparsity-Centric Hybrid Compute-in-Memory Architecture via Probabilistic Approxi…☆10Apr 12, 2025Updated last year
- ☆14Mar 20, 2026Updated 7 months ago
- Feed-forward neural networks can be trained based on a gradient-descent based backpropagation algorithm. But, these algorithms require mo…☆12Jul 4, 2020Updated 6 years ago
- ☆12May 19, 2025Updated last year
- Code and data for the paper "Plan-over-Graph: Towards Parallelable LLM Agent Schedule".☆15Jul 9, 2026Updated 4 months ago
- Trains Sparse Autoencoders based on outputs from language models☆11Oct 7, 2024Updated 2 years ago
- ☆12Aug 18, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ICML 2025] CommVQ: Commutative Vector Quantization for KV Cache Compression☆27Sep 2, 2025Updated last year
- [ACL 26 Findings] LogitSpec: Accelerating Retrieval-based Speculative Decoding via Next Next Token Speculation☆13Apr 21, 2026Updated 6 months ago
- The official implementation of NOSA (EMNLP 2026 main)☆19Sep 28, 2026Updated last month
- Source codes of "Fast Continuous Subgraph Matching over Streaming Graphs via Backtracking Reduction", SIGMOD 2023☆15Sep 7, 2023Updated 3 years ago
- ☆13Jun 11, 2026Updated 5 months ago
- Repository for the COLM 2025 paper SpecDec++: Boosting Speculative Decoding via Adaptive Candidate Lengths☆19Jul 10, 2025Updated last year
- Mutual information estimators and benchmarks☆14Oct 6, 2026Updated last month
Are these results useful?