🔥 [ICML'26] ParisKV: Fast and Drift-Robust KV-Cache Retrieval for Long-Context LLMs
☆36Aug 14, 2026Updated 2 months ago
Alternatives and similar repositories for ParisKV
Users that are interested in ParisKV are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [SIGMOD 2025] PQCache: Product Quantization-based KVCache for Long Context LLM Inference☆93Dec 7, 2025Updated 10 months ago
- [VLDB 26, NeurIPS 25] Scalable long-context LLM decoding that leverages sparsity—by treating the KV cache as a vector storage system.☆154Sep 14, 2026Updated last month
- ☆38Aug 4, 2026Updated 2 months ago
- Adamas: Hadamard Sparse Attention for Efficient Long-context Inference☆15Oct 1, 2026Updated 3 weeks ago
- [ICML 2025] RocketKV: Accelerating Long-Context LLM Inference via Two-Stage KV Cache Compression☆55Aug 7, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- FlowBlock: Wavefront-Parallel Decoding Framework for Self-Correcting Diffusion Language Models☆43Jul 21, 2026Updated 3 months ago
- The repo for the article: CSPG: Crossing Sparse Proximity Graphs for Approximate Nearest Neighbor Search☆12Dec 12, 2024Updated last year
- Official github repo for "Fractional Reasoning via Latent Steering Vectors Improves Inference Time Compute"☆18Jun 30, 2025Updated last year
- Segmented Code Adjustment Quantization (SAQ)☆28Sep 22, 2025Updated last year
- A High-Throughput Multi-GPU System for Graph-Based Approximate Nearest Neighbor Search☆21Jul 22, 2025Updated last year
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 3 months ago
- Muon in Int8 Precision Made Possible☆20Jun 18, 2026Updated 4 months ago
- ☆37Aug 7, 2025Updated last year
- The Official Implementation of Ada-KV [NeurIPS 2025]☆141Nov 26, 2025Updated 10 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Code and reproducibility artifacts for reconstructing megakernel persistence with CUDA PDL☆24Aug 5, 2026Updated 2 months ago
- Dynamic Context Selection for Efficient Long-Context LLMs☆64May 20, 2025Updated last year
- Repo for ECHO: Efficient KV Cache Offloading with Lossless Prefetching for Serving Native Sparse Attention LLMs (OSDI'26)☆38Jul 12, 2026Updated 3 months ago
- Implementation of "RaanA: A Fast, Flexible, and Data-Efficient Post-Training Quantization Algorithm"☆18Apr 11, 2025Updated last year
- The official implementation of NOSA (EMNLP 2026 main)☆19Sep 28, 2026Updated 3 weeks ago
- [NeurIPS'25 Spotlight] Adaptive Attention Sparsity with Hierarchical Top-p Pruning☆110Aug 31, 2026Updated last month
- Implementation for IceCache: Memory-Efficient KV-cache Management for Long-Sequence LLMs (ICLR 2026).☆25Jun 9, 2026Updated 4 months ago
- Modular Markdown-based audio skills for AI agents and developers, covering signal processing, synthesis, effects, analysis, and spatial a…☆22May 21, 2026Updated 5 months ago
- ☆16Jul 29, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code, Data and Model for Paper "Learning from Peers in Reasoning Models"☆26May 13, 2025Updated last year
- A list of multi-vector retrieval resources☆18May 29, 2024Updated 2 years ago
- Algorithm-System Co-design: accurate and efficient 2-bit KV cache quantization for LLM Inference.☆21May 20, 2026Updated 5 months ago
- High-Performance Embeddable Vector Database with Document Storage, Hybrid Search, and Filtering☆92Jun 4, 2026Updated 4 months ago
- DeepStack: Facilitating Co-Design Exploration of 3D DRAM-Stacked Accelerators for Distributed LLM Inference. Includes the MICRO 2026 AE a…☆65Oct 5, 2026Updated 2 weeks ago
- TurboQuant reference implementation — KV cache compression with engineering insights (ICLR 2026 paper reproduction)☆17Mar 28, 2026Updated 6 months ago
- [ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference☆316May 1, 2025Updated last year
- rabitq rust implementation☆11May 14, 2026Updated 5 months ago
- Official implementation of "Learning To Draft: Adaptive Speculative Decoding with Reinforcement Learning" (ICLR 2026)☆23Mar 1, 2026Updated 7 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Query-Aware LSH for Approximate NNS (PVLDB 2015 and VLDBJ 2017)☆28Jul 9, 2021Updated 5 years ago
- Flash-GMM, a memory-efficient GPU kernel that unlocks GMM soft clustering at billion-scale☆25Sep 30, 2026Updated 3 weeks ago
- Public repository for CleANN, an efficient fully-dynamic approximate nearest neighbor search index☆19Sep 18, 2025Updated last year
- ☆116Aug 5, 2026Updated 2 months ago
- A new query hardness measure for graph-based ANN indexes. Build unbiased workloads with this hardness to see the actual performance of yo…☆21May 6, 2026Updated 5 months ago
- A cross-modal vector index with fast construction on heterogeneous CPU-GPU environment. Published on DaMoN@SIGMOD 2025.☆16Jul 16, 2025Updated last year
- [ICML2025] Official code for "Reinforced Lifelong Editing for Language Models"☆22Feb 23, 2025Updated last year