Official implementation of "TailorKV: A Hybrid Framework for Long-Context Inference via Tailored KV Cache Optimization" (Findings of ACL 2025).
☆21Jul 25, 2025Updated 8 months ago
Alternatives and similar repositories for TailorKV
Users that are interested in TailorKV are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17Apr 17, 2025Updated 11 months ago
- Code for the note "NF4 Isn't Information Theoretically Optimal (and that's Good)☆21Jun 22, 2023Updated 2 years ago
- Residual vector quantization for KV cache compression in large language model☆12Oct 22, 2024Updated last year
- [ACL 2024 Findings] Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning☆13Sep 2, 2024Updated last year
- [SIGMOD 2025] PQCache: Product Quantization-based KVCache for Long Context LLM Inference☆83Dec 7, 2025Updated 3 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- This repository presents the source code for the paper "MILLION: Mastering Long-Context LLM Inference Via Outlier-Immunized KV Product Qu…☆23Apr 2, 2025Updated 11 months ago
- [ACL 2025] Squeezed Attention: Accelerating Long Prompt LLM Inference☆58Nov 20, 2024Updated last year
- [NeurIPS'25 Spotlight] Adaptive Attention Sparsity with Hierarchical Top-p Pruning☆90Nov 29, 2025Updated 3 months ago
- ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)☆52Dec 17, 2024Updated last year
- ☆47Nov 25, 2024Updated last year
- [CVPR 2025] LION-FS: Fast & Slow Video-Language Thinker as Online Video Assistant☆27Dec 2, 2025Updated 3 months ago
- ☆123Updated this week
- ☆13Jan 14, 2026Updated 2 months ago
- Implementation of Phenotype prediction from single-cell RNA-seq data using attention-based neural networks (Bioinformatics 2024).☆13Jul 15, 2024Updated last year
- NordVPN Threat Protection Pro™ • AdTake your cybersecurity to the next level. Block phishing, malware, trackers, and ads. Lightweight app that works with all browsers.
- ☆11Oct 31, 2021Updated 4 years ago
- [ICCV 2025] Implementation of the paper "Q-Frame: Query-aware Frame Selection and Multi-Resolution Adaptation for Video-LLMs"☆70Oct 25, 2025Updated 5 months ago
- [TMLR] CodePDE: An Inference Framework for LLM-driven PDE Solver Generation☆71Feb 12, 2026Updated last month
- [ICRA 2024] Official Implementation of the paper "Parameter-efficient Prompt Learning for 3D Point Cloud Understanding"☆30Mar 13, 2026Updated 2 weeks ago
- ☆11Sep 6, 2024Updated last year
- Matlab interface for SCS☆13Nov 24, 2025Updated 4 months ago
- PyTorch - CHIMLE, an IMLE-based general-purpose multimodal conditional image synthesis method [NeurIPS 2022]☆12Jun 13, 2023Updated 2 years ago
- Federated Unfolding Learning for CSI Feedback in Distributed Edge Networks☆10Jul 7, 2024Updated last year
- ☆20Dec 4, 2024Updated last year
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆20Jun 17, 2024Updated last year
- Matlab scripts for the paper "Machine Learning meets Stochastic Geometry: Determinantal Subset Selection for Wireless Networks"☆12May 4, 2019Updated 6 years ago
- [code] "A Markovian Model for Analyzing Opportunistic Request Routing in Wireless Cache Networks" by J. Dinal Herath and Anand Seetharam.…☆10Feb 27, 2019Updated 7 years ago
- ☆11Dec 4, 2025Updated 3 months ago
- This is a code package is related to the follow scientific article: Andrea Pizzo, Daniel Verenzuela, Luca Sanguinetti and Emil Björnson,…☆14May 18, 2018Updated 7 years ago
- ☆12Aug 24, 2023Updated 2 years ago
- This is the CUDA GPU implementation + Python interface (using PyTorch) of DCI. The paper can be found at https://arxiv.org/abs/1512.00442…☆13Dec 20, 2023Updated 2 years ago
- ☆16Apr 15, 2025Updated 11 months ago
- Modular and structured prompt caching for low-latency LLM inference☆109Nov 9, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Simulation code for the paper "FedSL: Federated Split Learning for Collaborative Healthcare Analytics on Resource-Constrained Wearable Io…☆16Feb 2, 2024Updated 2 years ago
- Simulation codes for over-the-air federated learning via second-order optimization☆14Jan 27, 2022Updated 4 years ago
- Algorithms re-implementation for paper "Power Allocation in Cache-Aided NOMA Systems: Optimization and Deep Reinforcement Learning Approa…☆12Jan 7, 2023Updated 3 years ago
- Artifacts Release: A Case for Stateless Mobile Core Network Functions in Space☆16Aug 16, 2022Updated 3 years ago
- This repository is about the paper and the code of "Beam grouping based user scheduling in multi-cell millimeter-wave MIMO systems".☆12Sep 23, 2021Updated 4 years ago
- ☆39Oct 11, 2025Updated 5 months ago
- Matlab code associated with the publication "Load Modulation for Backscatter Communication: Channel Capacity and Capacity-Approaching Fin…☆14Nov 15, 2022Updated 3 years ago