[EuroSys27] TokenCake: A KV-Cache-centric Serving Framework for LLM-based Multi-Agent Applications
☆14Oct 14, 2026Updated last week
Alternatives and similar repositories for TokenCake
Users that are interested in TokenCake are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- BlitzScale Router - Distributed LLM Inference Router (Rust)☆17May 25, 2026Updated 5 months ago
- ☆24Mar 3, 2026Updated 7 months ago
- ☆34Mar 12, 2026Updated 7 months ago
- TokenSim is a tool for simulating the behavior of large language models (LLMs) in a distributed environment.☆45Updated this week
- High-Throughput Batch Inference☆18Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆16Jan 12, 2026Updated 9 months ago
- ☆10Dec 7, 2024Updated last year
- ☆11Apr 18, 2020Updated 6 years ago
- [MICRO'20] LENS: A Low-level NVRAM Profiler [USENIX Security'23] NVLeak: Off-Chip Side-Channel Attacks via Non-Volatile Memory Systems☆14Jul 8, 2024Updated 2 years ago
- 2023/12/22 电三 420 每周会议技术分享：「容器」的 slides 和附件☆10Dec 22, 2023Updated 2 years ago
- ☆13Mar 28, 2025Updated last year
- Source code for the Information Sciences paper "Rumor Detection on Social Media through Mining the Social Circles with High Homogeneity"☆22Jun 10, 2023Updated 3 years ago
- Preview Code for Continuum Paper☆112Aug 13, 2026Updated 2 months ago
- Frontier: A Discrete-Event Simulator for Modern LLM Serving☆168Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- 北京大学未名超算队与北京大学学生 Linux 俱乐部合办的暑期 AI Infra 系列活动仓库☆252Aug 22, 2026Updated 2 months ago
- 我们安全了-暂时的☆11May 11, 2018Updated 8 years ago
- PipeWeave: Synergizing Analytical and Learning Models for Unified GPU Performance Prediction☆23Sep 2, 2026Updated last month
- Repo for ECHO: Efficient KV Cache Offloading with Lossless Prefetching for Serving Native Sparse Attention LLMs (OSDI'26)☆39Jul 12, 2026Updated 3 months ago
- ☆10Nov 20, 2024Updated last year
- ☆27Jan 18, 2026Updated 9 months ago
- 西南科技大学教务 QQ 机器人 base on NoneBot☆10Aug 29, 2020Updated 6 years ago
- Linux source tree with Mitosis extension for x86_64.☆13Dec 17, 2020Updated 5 years ago
- UDP packet obfuscation with eBPF, which tunnels UDP over pseudo-TCP☆10Jun 5, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- SHUOSC RISC-V implementation☆11May 12, 2024Updated 2 years ago
- Minimal PyTorch implementation of TP, SP, FSDP and sharded-EMA☆32Nov 27, 2025Updated 11 months ago
- A speicifically designed KV store for blockchain systems☆13Mar 10, 2025Updated last year
- ☆23Jun 24, 2021Updated 5 years ago
- ☆33Aug 18, 2026Updated 2 months ago
- ☆19Feb 18, 2025Updated last year
- ☆34Jul 13, 2026Updated 3 months ago
- An open toolkit and public dataset hub for collecting, sanitizing, analyzing, and visualizing coding agent traces.☆156Oct 19, 2026Updated last week
- This repo is Laser (LEO-NET'25 paper: How LLM Saved Me from Struggling with Experiment Reproduction: LEO Networking as A Case Study) sour…☆19Sep 6, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆14Nov 18, 2025Updated 11 months ago
- ☆10Oct 13, 2022Updated 4 years ago
- ☆10Apr 2, 2021Updated 5 years ago
- NEO is a LLM inference engine built to save the GPU memory crisis by CPU offloading☆98Jun 16, 2025Updated last year
- This repository contains the open source of the Pyramid sketch framework (accepted by VLDB 2017 and then submitted to ToN).☆21Sep 29, 2018Updated 8 years ago
- 随机生成中文地址☆12Nov 23, 2016Updated 9 years ago
- ☆20Aug 27, 2026Updated 2 months ago