Persist and reuse KV Cache to speedup your LLM.
☆297Jul 7, 2026Updated this week
Alternatives and similar repositories for unified-cache-management
Users that are interested in unified-cache-management are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICML 2026] Less Is More: Training-Free Sparse Attention with Global Locality for Efficient Reasoning☆33Sep 12, 2025Updated 9 months ago
- [NSDI25] AutoCCL: Automated Collective Communication Tuning for Accelerating Distributed and Parallel DNN Training☆32May 2, 2025Updated last year
- ONCache: A Cache-Based Low-Overhead Container Overlay Network☆21Jun 7, 2025Updated last year
- SocksDirect code repository☆20May 6, 2026Updated 2 months ago
- ☆298Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- AI Cluster Observability & Troubleshooting Toolkit. Powered by SII & Infrawaves.☆36Apr 29, 2026Updated 2 months ago
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding☆114Dec 2, 2025Updated 7 months ago
- Ceph is a distributed object, block, and file storage platform☆10Apr 21, 2026Updated 2 months ago
- multi-streamed F2FS: An NVMe ZNS SSD optimized F2FS File System with concurrently writable hot/warm/cold data streams and application-gui…☆25Mar 16, 2023Updated 3 years ago
- 国内首个企业级 IT 运维多 Agent 自动化平台 — 基于大语言模型的智能运维解决方案。ITOps Agent Platform通过可视化工作流编排，将多个AI Agent组合成智能运维自动化流水线，实现服务器管理、告警处理、故障诊断、日志分析 、脚本管理、定时运维任务的…☆413Jun 30, 2026Updated last week
- Compact and Agent-Native MoE Training System☆219Jun 30, 2026Updated last week
- PTX ISA 9.1 documentation converted to searchable markdown. Includes Claude Code skill for CUDA development.☆211Dec 24, 2025Updated 6 months ago
- KV cache store for distributed LLM inference☆422Nov 13, 2025Updated 7 months ago
- High Performance KV Cache Store for LLM☆56May 20, 2026Updated last month
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond☆1,091Updated this week
- LMCache on Ascend☆77Jun 26, 2026Updated last week
- Hooked CUDA-related dynamic libraries by using automated code generation tools.☆173Dec 12, 2023Updated 2 years ago
- AI大模型的基本开发框架，适合普通后端程序员，功能类似coze包括：fastapi后端接口，搜索，文档解析和向量化，RPA和爬虫，自定义agent，对接第三方数据接口，mongodb数据库，控制json返回，多模态理解和生成等等☆13Jul 18, 2024Updated last year
- ☆25Jan 10, 2023Updated 3 years ago
- ☆16Jul 12, 2024Updated last year
- 【今日头条】文本作者身份识别比赛☆10Aug 20, 2018Updated 7 years ago
- Implement FlashAttention v2 with minimal code to learn.☆16Jun 12, 2024Updated 2 years ago
- ☆19May 26, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- HMS - Harmful Brain Activity Classification☆13May 8, 2024Updated 2 years ago
- High-performance KV cache storage for LLM inference — GPU offloading, SSD caching, and cross-node sharing via RDMA. Works with vLLM and S…☆162Updated this week
- BH hackathon☆14Apr 4, 2024Updated 2 years ago
- ☆32Jun 30, 2026Updated last week
- Pico is a numpy-based "pico" neural network framework, with torch-like coding style and auto-grad implementation., with MNIST example.☆11Mar 11, 2022Updated 4 years ago
- ☆13Apr 9, 2025Updated last year
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆5,749Updated this week
- ☆14Jan 20, 2025Updated last year
- A curated list of awesome tools, frameworks, platforms, and resources for building scalable and efficient AI infrastructure, including di…☆62May 11, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- SC 2021, "LogECMem: Coupling Erasure-Coded In-Memory Key-Value Stores with Parity Logging"☆12Jul 12, 2021Updated 4 years ago
- Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSi…☆203Jun 29, 2026Updated last week
- ☆15Jan 27, 2026Updated 5 months ago
- Parallel Prefix Sum (Scan) with CUDA☆30Jun 22, 2024Updated 2 years ago
- ECIR 2024: Sparse lexical representation for image-text retrieval☆13Jul 8, 2024Updated 2 years ago
- A vision-based RL environment for the Franka Panda arm using NVIDIA Isaac Sim☆19Jan 3, 2025Updated last year
- ☆40May 19, 2026Updated last month