Models Take Notes at Prefill: KV Cache Can Be Editable and Composable (arXiv:2606.17107) — paper, code, results, and interactive companion.
☆16Jun 29, 2026Updated 3 months ago
Alternatives and similar repositories for programmable-kv
Users that are interested in programmable-kv are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆22Jul 13, 2026Updated 3 months ago
- Understanding AI-DLC: A Living Open-Source Book Powered by a GitHub-Native Writing System. 《深入理解 AI-DLC》：持续更新的开源…☆33Oct 15, 2026Updated last week
- Block-GTQ: RoPE-aware bit allocation for KV-cache quantization☆15Jun 24, 2026Updated 4 months ago
- A high-performance, RDMA-native data-plane library for large-scale heterogeneous memory pools, developed by the Tencent Astral Network Te…☆33Aug 6, 2026Updated 2 months ago
- ☆14Jun 3, 2026Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Clean-room reimplementation of ClickNP (SIGCOMM 2016) on Alveo U50☆28May 28, 2026Updated 4 months ago
- Official implementation of "SentenceKV: Efficient LLM Inference via Sentence-Level Semantic KV Caching" (COLM 2025). A novel KV cache com…☆15Sep 29, 2025Updated last year
- ☆50Oct 16, 2025Updated last year
- Voice input that transcribes what you said, grounded in what's on your screen. macOS, Windows, Android, iOS.☆55Oct 3, 2026Updated 3 weeks ago
- AgentReach (reach): Point your coding agent at any box you can SSH into. The server never gets your agent.☆185Sep 23, 2026Updated last month
- Efficient GPU communication over multiple NICs.☆31Nov 20, 2025Updated 11 months ago
- ☆13Apr 9, 2025Updated last year
- ☆19Aug 16, 2025Updated last year
- ☆11Aug 14, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- code for infocom 2021 paper MANDA☆11May 30, 2023Updated 3 years ago
- PreAct: Computer-Using Agents that Get Faster on Repeated Tasks (arXiv:2606.17929). Compile successful runs into verified state-machine p…☆18Jun 17, 2026Updated 4 months ago
- A distributed stream querying engine that provides sub-millisecond stateful query at millions of queries per-second over fast-evolving li…☆10Jul 18, 2018Updated 8 years ago
- ☆14Jun 18, 2026Updated 4 months ago
- 在原版multiple-attention,重新修订数据处理方式和训练代码☆10Mar 21, 2024Updated 2 years ago
- Incremental View Maintenance support for DuckDB☆18Oct 24, 2023Updated 3 years ago
- ☆20Oct 15, 2024Updated 2 years ago
- ☆12Jul 19, 2022Updated 4 years ago
- A multistate dataset for colposcopy image classification of cervical cancer screening☆11Dec 4, 2020Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- The official repo for the paper "Optimizing LLM Inference Throughput via Memory-aware and SLA-constrained Dynamic Batching"☆17Mar 17, 2025Updated last year
- A benchmark framework for decision forest inferences☆11Jan 19, 2024Updated 2 years ago
- DEPRECATED REPOSITORY. ROCm Inference Transfer Library (RIXL) is a port of the NIXL library for AMD GPUs. See README_rocm.md for AMD spe…☆15Updated this week
- ☆13Sep 23, 2025Updated last year
- 中国科大图书馆查询机生成脚本☆17Oct 10, 2026Updated 2 weeks ago
- Ultrasound-specific image transforms for training deep neural networks.☆17Jul 18, 2025Updated last year
- A novel system that unifies LLM serving with query optimization to efficiently process batch agentic workflows.☆16Oct 7, 2026Updated 2 weeks ago
- Git Repo with code and Dataset of the paper "On the use of Stable Diffusion for creating realistic faces: from generation to detection"☆14Mar 11, 2024Updated 2 years ago
- Rich and fast user-defined functions in relational databases☆21Sep 8, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- GPA calculator for USTCers☆11Nov 3, 2018Updated 7 years ago
- A parser for PTX 6.5☆13Jun 19, 2023Updated 3 years ago
- 本笔记基于哈工大李治军老师的课程，以及王道考研资料，B站CodeSheep的知识梳理，各大论坛的博客等，从各个渠道中获取精华，成为这些笔记。☆13Nov 26, 2020Updated 5 years ago
- ☆18May 21, 2025Updated last year
- A Triton-only attention backend for vLLM☆28Jul 14, 2026Updated 3 months ago
- A dataset for Chinese Internet meme explanation☆26Nov 3, 2025Updated 11 months ago
- [ICML 2025] CommVQ: Commutative Vector Quantization for KV Cache Compression☆27Sep 2, 2025Updated last year