[ACL 2026] Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization
☆377Aug 7, 2026Updated last week
Alternatives and similar repositories for Awesome-KV-Cache-Optimization
Users that are interested in Awesome-KV-Cache-Optimization are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fast Parallel Probabilistic Graphical Model Learning and Inference [IPDPS'22, PPoPP'23, USENIX ATC'24]☆77Oct 26, 2025Updated 9 months ago
- [ACL 2026] Official evaluation code for “MMErroR: A Benchmark for Erroneous Reasoning in Vision-Language Models”.☆19Apr 26, 2026Updated 3 months ago
- This repository contains the code used in the paper "LGFFM: A Localized and Globalized Frequency Fusion Model for Ultrasound Image Segmen…☆22Feb 5, 2026Updated 6 months ago
- 基于SAM和混合智能的半自动医学影像分割软件☆100Jun 1, 2026Updated 2 months ago
- ECCV 2026 accepted CACFM code: RL-guided curvature-adaptive consistency flow matching for few-step FLUX/SDXL generation☆55Jun 25, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [ICLR 2023 Spotlight] Re-calibrating Feature Attributions for Model Interpretation☆36Jan 21, 2026Updated 6 months ago
- [FPGA 2020] A systematic framework for optimizing OpenCL applications on FPGAs☆20Apr 9, 2023Updated 3 years ago
- [CVPR 2024] Efficient Hyperparameter Optimization with Adaptive Fidelity Identification☆12Jul 12, 2024Updated 2 years ago
- [CVPR 2026] ConsisVLA-4D: Advancing Spatiotemporal Consistency in Efficient 3D-Perception and 4D-Reasoning for Robotic Manipulation☆47May 8, 2026Updated 3 months ago
- Sparse Adapter Fusion for Continual Learning in NLP - EACL 2026☆16Apr 9, 2026Updated 4 months ago
- [2025CVPR] FlowRAM: Grounding Flow Matching Policy with Region-Aware Mamba Framework for Robotic Manipulation☆54May 30, 2026Updated 2 months ago
- [ACM MM 2025] SVGenius: Benchmarking LLMs in SVG Understanding, Editing and Generation. https://arxiv.org/abs/2506.03139☆78Nov 10, 2025Updated 9 months ago
- [AAAI 2026] CADTrack: Learning Contextual Aggregation with Deformable Alignment for Robust RGBT Tracking☆177Jun 3, 2026Updated 2 months ago
- [IEEE TPAMI] LRANet++: Low-Rank Approximation Network for Accurate and Efficient Text Spotting☆30Dec 2, 2025Updated 8 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Source code of IEEE TCOM paper: Synesthesia of Machines (SoM)-Enhanced ISAC Precoding for Vehicular Networks With Double Dynamics.☆36Dec 24, 2025Updated 7 months ago
- Quantify and analyze distribution shifts in learning from samples.☆35Oct 25, 2025Updated 9 months ago
- A macOS Photos–style photo manager for Windows — folder-native, non-destructive, with HEIC/MOV Live Photo, map view, and GPU-accelerated …☆207Updated this week
- ActorMind: Emulating Human Actor Reasoning for Speech Role-Playing - ACL Findings 2026☆25Jul 15, 2026Updated last month
- [CVPR 2025] LION-FS: Fast & Slow Video-Language Thinker as Online Video Assistant☆29Dec 2, 2025Updated 8 months ago
- Source code of IEEE TVT paper: Superposed IM-OFDM (S-IM-OFDM) : An enhanced OFDM waveform for Integrated Sensing and Communications (ISAC…☆19Nov 7, 2025Updated 9 months ago
- [NeurIPS 2025] CogVLA: Cognition-Aligned Vision-Language-Action Models via Instruction-Driven Routing & Sparsification☆186Jun 17, 2026Updated 2 months ago
- A modular program analysis tool framework for accelerators (NVIDIA, AMD, and DL workloads).☆26Jul 5, 2026Updated last month
- Ziren(formerly zkMIPS): An open-source, simple, stable, and universal zkVM on MIPS32.☆116Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Decentralized App for LGBTQ+ Community☆16May 4, 2026Updated 3 months ago
- Universal memory layer for AI Agents. It provides scalable, extensible, and interoperable memory storage and retrieval to streamline AI a…☆3,177Updated this week
- silky 是一套面向 Spring Boot 的轻量级、高性能开源组件生态，致力于解决微服务开发中的通用技术痛点。目前已发布以下核心组件：OSS、MongoDB、redis、rabbitMQ、fastExcel等，目标：让开发者"开箱即用"，专注业务，告别重复造轮子！☆23May 27, 2026Updated 2 months ago
- Similarity-Guided Layer-Adaptive Vision Transformer for UAV Tracking (CVPR 2025)☆117Updated this week
- 用户面试平台☆23Aug 1, 2025Updated last year
- [TGRS 2025] Multiscale Restoration of Missing Data in Optical Time-series Images With Masked Spatial-Temporal Attention Network☆20Jan 27, 2026Updated 6 months ago
- Observability platform for Digital Employee, providing real-time tracing, session insights, and cost analysis for multi-agent workflows☆135May 20, 2026Updated 2 months ago
- [ICCV 2025 Highlight] Panorama Generation as a Next-Token Prediction Task.☆48Oct 29, 2025Updated 9 months ago
- ☆65Mar 23, 2026Updated 4 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- (eBook，PDFs Translation) A multilingual eBook processing tool supporting all eBook formats. Features online and offline translation while…☆1,312Sep 28, 2025Updated 10 months ago
- A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.☆38May 30, 2026Updated 2 months ago
- Proximity-based Multi-turn Optimization (ProxMO) - Official Implementation☆60Mar 29, 2026Updated 4 months ago
- 📰 Must-read papers on KV Cache Compression (constantly updating 🤗).☆734Updated this week
- Unified LLM gateway with weighted load balancing, observability & cost tracking. 统一的 LLM 网关，提供权重负载均衡、可观测性与费用追踪。☆313Updated this week
- 全语言制品仓库，涵盖npm、Maven、PyPi、Docker、Gradle、SBT、Cocoapods、Swift、RPM、Debian、PHP、Go、Pub、Ivy、NuGet、Conda、Cargo、Conan、Yarn、GitLFS、Helm、OHPM等主流工具,涵…☆2,176Jul 30, 2026Updated 2 weeks ago
- [CVPR 2024] RankMatch: Exploring the Better Consistency Regularization for Semi-supervised Semantic Segmentation☆35Feb 25, 2025Updated last year