Official Repo for paper "VLCache: Computing 2% Vision Tokens and Reusing 98% for Vision-Language Inference"
☆16Mar 28, 2026Updated 7 months ago
Alternatives and similar repositories for VLCache
Users that are interested in VLCache are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13Jun 11, 2026Updated 5 months ago
- A lightweight CuTe-based CUDA kernel for DuoAttention, optimized for large language model inference.☆12Dec 25, 2025Updated 10 months ago
- [ICLR 2026] Official code repository for "⚡️VisionTrim: Unified Vision Token Compression for Training-Free MLLM Acceleration"☆58Jun 17, 2026Updated 4 months ago
- Resource Multiplexing in Tuning and Serving Large Language Models (USENIX ATC 2025)☆10Apr 21, 2026Updated 6 months ago
- Comparative study and experimentation on standard vs mHC vs attention residual (full and block)☆13Mar 17, 2026Updated 7 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Copy as an OS Service☆27Nov 20, 2025Updated 11 months ago
- ☆10Dec 18, 2025Updated 10 months ago
- A scheduling framework for multitasking over diverse XPUs, including GPUs, NPUs, ASICs, and FPGAs☆14Jun 17, 2026Updated 4 months ago
- [ICCV 2025] Official code for paper: Beyond Text-Visual Attention: Exploiting Visual Cues for Effective Token Pruning in VLMs☆85Jul 1, 2025Updated last year
- Implementation of "RelayCaching: Accelerating LLM Collaboration via Decoding KV Cache Reuse".☆12May 29, 2026Updated 5 months ago
- ☆14May 11, 2026Updated 6 months ago
- ☆12Oct 23, 2025Updated last year
- ☆25Mar 3, 2026Updated 8 months ago
- ☆207Jul 15, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆23Jul 13, 2026Updated 3 months ago
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆57Aug 6, 2025Updated last year
- VideoNSA: Native Sparse Attention Scales Video Understanding☆91Nov 16, 2025Updated 11 months ago
- SC'25 UltraAttn: Efficiently Parallelizing Attention through Hierarchical Context-Tiling☆16Aug 14, 2025Updated last year
- Implementation of the paper "ProxyAttn: Guided Sparse Attention via Representative Heads".☆14Mar 9, 2026Updated 8 months ago
- An Evolving List of Distributed LLM and Multimodal LLM Papers and Repositories☆15May 4, 2025Updated last year
- Ollama 기반의 int4 gguf 형식 sLLM을 multi-turn 형태로 대화할 수 있는 통합 모듈☆14Jul 25, 2024Updated 2 years ago
- [ACL 2026 Main] See the Forest for the Trees: Loosely Speculative Decoding via Visual-Semantic Guidance for Efficient Inference of Video …☆32Jul 4, 2026Updated 4 months ago
- ☆26Oct 3, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Training-free anti-recomputation for video vision-language models.☆25Jun 5, 2026Updated 5 months ago
- Vortex: Programmable Sparse Attention for Agents as Algorithm Designers☆69Aug 22, 2026Updated 2 months ago
- ☆22Apr 17, 2026Updated 6 months ago
- 20251101-https://arxiv.org/pdf/2510.21603☆10Nov 3, 2025Updated last year
- WinARDet: Compressed Window Auto-Regression for Long-Horizon Vision-Language Grounding☆17Oct 15, 2026Updated 3 weeks ago
- [ICLR 2026] KVComm: Enabling Efficient LLM Communication through Selective KV Sharing☆21Jan 26, 2026Updated 9 months ago
- Elastic Attention: Test-time Adaptive Sparsity Ratios for Efficient Transformers☆24May 26, 2026Updated 5 months ago
- ☆20Nov 22, 2025Updated 11 months ago
- Seeing is Not Reasoning: MVPBench for Graph-based Evaluation of Multi-path Visual Physical CoT☆14Jul 30, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ICLR 2026🔥] SHIELD: Suppressing Hallucinations In LVLM Encoders via Bias and Vulnerability Defense☆21Mar 24, 2026Updated 7 months ago
- ☆21May 11, 2026Updated 6 months ago
- Accurate and fast KV cache compression with a gating mechanism☆35Jul 27, 2026Updated 3 months ago
- [CVPR 2025] DivPrune: Diversity-based Visual Token Pruning for Large Multimodal Models☆93Apr 16, 2026Updated 6 months ago
- ☆19Oct 14, 2026Updated 3 weeks ago
- code for "Tying the Loop - Tied Expert Layers in Mixture-of-Experts Language Models"☆15Jun 16, 2026Updated 4 months ago
- FreeKV: Boosting KV Cache Retrieval for Efficient LLM Inference (ICLR'26)☆12Mar 5, 2026Updated 8 months ago
Are these results useful?