[EuroSys27] TokenCake: A KV-Cache-centric Serving Framework for LLM-based Multi-Agent Applications
☆15Nov 10, 2026Updated last week
Alternatives and similar repositories for TokenCake
Users that are interested in TokenCake are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GPU computing assignments and projects for graduate students.☆22Updated this week
- TokenSim is a tool for simulating the behavior of large language models (LLMs) in a distributed environment.☆48Nov 4, 2026Updated last week
- BlitzScale Router - Distributed LLM Inference Router (Rust)☆18May 25, 2026Updated 5 months ago
- Preview Code for Continuum Paper☆113Oct 26, 2026Updated 3 weeks ago
- An efficient service for transparent GPU multiplexing with VRAM oversubscription, OSDI '26☆14Sep 24, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Do multiple agents sharing a single asymmetrically-compressed KV pool produce quality output comparable to full-precision per-agent KV ca…☆13Apr 26, 2026Updated 6 months ago
- ☆37Mar 12, 2026Updated 8 months ago
- Inference Serving Framework☆28Oct 19, 2026Updated 3 weeks ago
- ☆25Updated this week
- PKUAutoElective 服务器容器部署☆12Feb 23, 2024Updated 2 years ago
- [ICCD26] A fast simulator for mixed-precision RRAM and SRAM compute-in-memory AI processors☆12Dec 11, 2025Updated 11 months ago
- ☆10Dec 7, 2024Updated last year
- ☆11Apr 18, 2020Updated 6 years ago
- [NAACL 2025🔥] MEDA: Dynamic KV Cache Allocation for Efficient Multimodal Long-Context Inference☆23Jun 19, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- High-Throughput Batch Inference☆22Updated this week
- [MICRO'20] LENS: A Low-level NVRAM Profiler [USENIX Security'23] NVLeak: Off-Chip Side-Channel Attacks via Non-Volatile Memory Systems☆14Jul 8, 2024Updated 2 years ago
- 2023/12/22 电三 420 每周会议技术分享:「容器」的 slides 和附件☆10Dec 22, 2023Updated 2 years ago
- An accelerator for high-dimensional approximate nearest neighbor search☆15May 17, 2025Updated last year
- ☆16Jan 12, 2026Updated 10 months ago
- 我们安全了-暂时的☆11May 11, 2018Updated 8 years ago
- ☆21May 14, 2025Updated last year
- ☆13Mar 28, 2025Updated last year
- ☆10Jun 11, 2019Updated 7 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆10Nov 20, 2024Updated last year
- Source code for the Information Sciences paper "Rumor Detection on Social Media through Mining the Social Circles with High Homogeneity"☆22Jun 10, 2023Updated 3 years ago
- Accepted by NAACL 2025 main conference.☆11Jan 24, 2025Updated last year
- 交大云盘同步CLI☆12Apr 19, 2024Updated 2 years ago
- 西南科技大学教务 QQ 机器人 base on NoneBot☆10Aug 29, 2020Updated 6 years ago
- Linux source tree with Mitosis extension for x86_64.☆13Dec 17, 2020Updated 5 years ago
- ☆28Jan 18, 2026Updated 9 months ago
- 在 WSL2 / x86 / ARM 上构建可使用Claude Code 的 Android 模拟器,并验证 Google Play Integrity。由 PhoneForClaude v0.7 独立。☆21Nov 8, 2026Updated last week
- SHUOSC RISC-V implementation☆11May 12, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Minimal PyTorch implementation of TP, SP, FSDP and sharded-EMA☆32Nov 27, 2025Updated 11 months ago
- ☆19Feb 18, 2025Updated last year
- This repo is Laser (LEO-NET'25 paper: How LLM Saved Me from Struggling with Experiment Reproduction: LEO Networking as A Case Study) sour…☆19Sep 6, 2025Updated last year
- ☆10May 11, 2026Updated 6 months ago
- A Full-System Framework for Simulating NDP devices from Caches to DRAM☆22Jan 12, 2024Updated 2 years ago
- ☆10Oct 13, 2022Updated 4 years ago
- ☆23Jun 24, 2021Updated 5 years ago
Are these results useful?