[ACL 2026] Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization
☆363Jun 28, 2026Updated last month
Alternatives and similar repositories for Awesome-KV-Cache-Optimization
Users that are interested in Awesome-KV-Cache-Optimization are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ACL 2026] Official evaluation code for “MMErroR: A Benchmark for Erroneous Reasoning in Vision-Language Models”.☆19Apr 26, 2026Updated 3 months ago
- An edge-computing-based smart home AI Agent system, built upon the "EdgeIoT-SmartHomeGateway" project. It enables autonomous orchestratio…☆17Apr 19, 2026Updated 3 months ago
- Fast Parallel Probabilistic Graphical Model Learning and Inference [IPDPS'22, PPoPP'23, USENIX ATC'24]☆77Oct 26, 2025Updated 9 months ago
- AI-powered platform for learning GitHub repos — AI code explanation, prerequisite extraction, auto-generated quizzes, streaming chat, tea…☆31May 9, 2026Updated 2 months ago
- 基于SAM和混合智能的半自动医学影像分割软件☆98Jun 1, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- [ICLR 2023 Spotlight] Re-calibrating Feature Attributions for Model Interpretation☆36Jan 21, 2026Updated 6 months ago
- 这是一个结合了RAG（Retrieval-Augmented Generation）和网络搜索功能的Agent项目，能够同时检索本地知识库和进行网络搜索，为用户提供全面的信息服务。项目通过API调用大语言模型进行推理，同时使用本地的bce-embedding-base_v1…☆32Dec 29, 2025Updated 7 months ago
- 🚀 Enterprise-level RAG system built with LangGraph, featuring hybrid retrieval, reranking, query rewriting, and incremental indexing.☆21Jul 21, 2026Updated last week
- [FPGA 2020] A systematic framework for optimizing OpenCL applications on FPGAs☆20Apr 9, 2023Updated 3 years ago
- [AAAI 2026 Oral] SemanticVLA: Semantic-Aligned Sparsification and Enhancement for Efficient Robotic Manipulation☆71Apr 5, 2026Updated 3 months ago
- Source code of IEEE TCOM paper: Synesthesia of Machines (SoM)-Enhanced ISAC Precoding for Vehicular Networks With Double Dynamics.☆35Dec 24, 2025Updated 7 months ago
- CX-Mind: A Pioneering Multimodal Large Language Model for Interleaved Reasoning in Chest X-ray via Curriculum-Guided Reinforcement Lear…☆125Dec 1, 2025Updated 7 months ago
- Quantify and analyze distribution shifts in learning from samples.☆35Oct 25, 2025Updated 9 months ago
- A macOS Photos–style photo manager for Windows — folder-native, non-destructive, with HEIC/MOV Live Photo, map view, and GPU-accelerated …☆193Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ActorMind: Emulating Human Actor Reasoning for Speech Role-Playing - ACL Findings 2026☆25Jul 15, 2026Updated 2 weeks ago
- RE:从0开始的RAG学习生活。包含LangChain、LangGraph、LangSmith、PydanticAI等框架和工具的学习教程。☆38Jun 10, 2026Updated last month
- A Chrome extension to navigate long Gemini conversations.☆37Jul 7, 2026Updated 3 weeks ago
- 🚀 基于 Vue3、TypeScript、Vite 的企业级中后台快速开发框架，采用模块化设计，内置丰富的业务组件。☆26Oct 16, 2025Updated 9 months ago
- Source code of IEEE TVT paper: Superposed IM-OFDM (S-IM-OFDM) : An enhanced OFDM waveform for Integrated Sensing and Communications (ISAC…☆19Nov 7, 2025Updated 8 months ago
- [NeurIPS 2025] CogVLA: Cognition-Aligned Vision-Language-Action Models via Instruction-Driven Routing & Sparsification☆185Jun 17, 2026Updated last month
- Decentralized App for LGBTQ+ Community☆16May 4, 2026Updated 2 months ago
- ☆51Jan 20, 2025Updated last year
- silky 是一套面向 Spring Boot 的轻量级、高性能开源组件生态，致力于解决微服务开发中的通用技术痛点。目前已发布以下核心组件：OSS、MongoDB、redis、rabbitMQ、fastExcel等，目标：让开发者"开箱即用"，专注业务，告别重复造轮子！☆23May 27, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…☆343Jul 16, 2026Updated 2 weeks ago
- TorchHook: A PyTorch hooks manager, providing convenient interfaces to capture feature maps and debug models.☆18Oct 1, 2025Updated 9 months ago
- Similarity-Guided Layer-Adaptive Vision Transformer for UAV Tracking (CVPR 2025)☆98Apr 21, 2026Updated 3 months ago
- [TGRS 2025] Multiscale Restoration of Missing Data in Optical Time-series Images With Masked Spatial-Temporal Attention Network☆20Jan 27, 2026Updated 6 months ago
- [ICCV 2025 Highlight] Panorama Generation as a Next-Token Prediction Task.☆48Oct 29, 2025Updated 9 months ago
- OTFS-channel-estimation☆70Jun 21, 2025Updated last year
- A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.☆36May 30, 2026Updated last month
- [PG 2025] BoxFusion: Reconstruction-Free Open-Vocabulary 3D Object Detection via Real-Time Multi-View Box Fusion☆66Jan 19, 2026Updated 6 months ago
- 📰 Must-read papers on KV Cache Compression (constantly updating 🤗).☆728Apr 15, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆35Apr 1, 2026Updated 3 months ago
- KWeaver Core is a harness-first foundation for enterprise decision agents. It turns fragmented data, knowledge, tools, and policies into …☆849May 29, 2026Updated 2 months ago
- [CVPR 2026] Official repository for "SAMIX: Reinforcing SAM2 with Semantic Adapter and Reference Selecting Policy for Mix-Supervised Segm…☆26Jun 3, 2026Updated last month
- The code of paper "DeFillet: Detection and Removal of Fillet Regions in Polygonal CAD Models" , ACM Transactions on Graphics (SIGGRAPH 20…☆92Dec 14, 2025Updated 7 months ago
- AI狼人杀一多智能体协作与博弈的AgentTeam实战☆30May 22, 2026Updated 2 months ago
- M-Cube (M³) — Multi-thinking, Multimodal, Multi-verification Patent Drafting Assistant☆204May 23, 2026Updated 2 months ago
- [CVPR 2026] Diff4Splat: Controllable 4D Scene Generation with Latent Dynamic Reconstruction Models.☆119Apr 9, 2026Updated 3 months ago