[ACL 2026] Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization
☆398Aug 7, 2026Updated last month
Alternatives and similar repositories for Awesome-KV-Cache-Optimization
Users that are interested in Awesome-KV-Cache-Optimization are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆28Aug 30, 2026Updated last week
- An edge-computing-based smart home AI Agent system, built upon the "EdgeIoT-SmartHomeGateway" project. It enables autonomous orchestratio…☆17Apr 19, 2026Updated 4 months ago
- Fast Parallel Probabilistic Graphical Model Learning and Inference [IPDPS'22, PPoPP'23, USENIX ATC'24]☆77Oct 26, 2025Updated 10 months ago
- [ACL 2026] Official evaluation code for “MMErroR: A Benchmark for Erroneous Reasoning in Vision-Language Models”.☆19Apr 26, 2026Updated 4 months ago
- A Verilog implementation of Fast Polynomial Multiplier (FPM) using Number Theoretic Transform.☆176Jun 26, 2026Updated 2 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- AI-powered platform for learning GitHub repos — AI code explanation, prerequisite extraction, auto-generated quizzes, streaming chat, tea…☆32May 9, 2026Updated 3 months ago
- This repository contains the code used in the paper "LGFFM: A Localized and Globalized Frequency Fusion Model for Ultrasound Image Segmen…☆23Feb 5, 2026Updated 7 months ago
- 基于SAM和混合智能的半自动医学影像分割软件☆102Jun 1, 2026Updated 3 months ago
- ECCV 2026 accepted CACFM code: RL-guided curvature-adaptive consistency flow matching for few-step FLUX/SDXL generation☆55Jun 25, 2026Updated 2 months ago
- 这是一个结合了RAG(Retrieval-Augmented Generation)和网络搜索功能的Agent项目,能够同时检索本地知识库和进行网络搜索,为用户提供全面的信息服务。项目通过API调用大语言模型进行推理,同时使用本地的bce-embedding-base_v1…☆31Dec 29, 2025Updated 8 months ago
- 🚀 Enterprise-level RAG system built with LangGraph, featuring hybrid retrieval, reranking, query rewriting, and incremental indexing.☆22Aug 7, 2026Updated last month
- [FPGA 2020] A systematic framework for optimizing OpenCL applications on FPGAs☆20Apr 9, 2023Updated 3 years ago
- QUIT: A Human-in-the-Loop Platform for AI Research Automation☆83Jun 4, 2026Updated 3 months ago
- Sparse Adapter Fusion for Continual Learning in NLP - EACL 2026☆16Apr 9, 2026Updated 4 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Source code of IEEE TCOM paper: Synesthesia of Machines (SoM)-Enhanced ISAC Precoding for Vehicular Networks With Double Dynamics.☆36Dec 24, 2025Updated 8 months ago
- CX-Mind: A Pioneering Multimodal Large Language Model for Interleaved Reasoning in Chest X-ray via Curriculum-Guided Reinforcement Lear…☆127Dec 1, 2025Updated 9 months ago
- A macOS Photos–style photo manager for Windows — folder-native, non-destructive, with HEIC/MOV Live Photo, map view, and GPU-accelerated …☆213Updated this week
- 一个基于 Vue 3 的检索增强生成(RAG)流程可视化演示系统☆26Apr 17, 2026Updated 4 months ago
- RE:从0开始的RAG学习生活。包含LangChain、LangGraph、LangSmith、PydanticAI等框架和工具的学习教程。☆42Jun 10, 2026Updated 2 months ago
- Prototype Conditioned Generative Replay for Continual Learning in NLP - NAACL 2025☆26Jul 28, 2026Updated last month
- A Chrome extension to navigate long Gemini conversations.☆37Jul 7, 2026Updated 2 months ago
- 🚀 基于 Vue3、TypeScript、Vite 的企业级中后台快速开发框架,采用模块化设计,内置丰富的业务组件。☆27Oct 16, 2025Updated 10 months ago
- MJLAB reinforcement learning for Go2 quadruple robot with ARX-L5 arm.☆45May 30, 2026Updated 3 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- [CVPR 2025] LION-FS: Fast & Slow Video-Language Thinker as Online Video Assistant☆29Dec 2, 2025Updated 9 months ago
- Source code of IEEE TVT paper: Superposed IM-OFDM (S-IM-OFDM) : An enhanced OFDM waveform for Integrated Sensing and Communications (ISAC…☆19Nov 7, 2025Updated 10 months ago
- A modular program analysis tool framework for accelerators (NVIDIA, AMD, and DL workloads).☆26Jul 5, 2026Updated 2 months ago
- Ziren(formerly zkMIPS): An open-source, simple, stable, and universal zkVM on MIPS32.☆116Updated this week
- Decentralized App for LGBTQ+ Community☆16May 4, 2026Updated 4 months ago
- ☆51Jan 20, 2025Updated last year
- silky 是一套面向 Spring Boot 的轻量级、高性能开源组件生态,致力于解决微服务开发中的通用技术痛点。目前已发布以下核心组件:OSS、MongoDB、redis、rabbitMQ、fastExcel等,目标:让开发者"开箱即用",专注业务,告别重复造轮子!☆23Updated this week
- TorchHook: A PyTorch hooks manager, providing convenient interfaces to capture feature maps and debug models.☆18Oct 1, 2025Updated 11 months ago
- This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…☆355Jul 16, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Similarity-Guided Layer-Adaptive Vision Transformer for UAV Tracking (CVPR 2025)☆124Aug 14, 2026Updated 3 weeks ago
- 用户面试平台☆23Aug 1, 2025Updated last year
- [TGRS 2025] Multiscale Restoration of Missing Data in Optical Time-series Images With Masked Spatial-Temporal Attention Network☆20Jan 27, 2026Updated 7 months ago
- Observability platform for Digital Employee, providing real-time tracing, session insights, and cost analysis for multi-agent workflows☆135May 20, 2026Updated 3 months ago
- [ICCV 2025 Highlight] Panorama Generation as a Next-Token Prediction Task.☆48Oct 29, 2025Updated 10 months ago
- ☆65Mar 23, 2026Updated 5 months ago
- A lightweight open-source tool for tracking daily RSI(6) signals on a stock watchlist.☆26May 27, 2026Updated 3 months ago