Implementation of "RelayCaching: Accelerating LLM Collaboration via Decoding KV Cache Reuse".
☆10May 29, 2026Updated 5 months ago
Alternatives and similar repositories for RelayCaching
Users that are interested in RelayCaching are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15May 6, 2026Updated 6 months ago
- WBSR: Rethinking Imbalance in Image Super-Resolution for Efficient Inference☆13Oct 8, 2024Updated 2 years ago
- FastVR: Real-Time Video Restoration with One-Step Diffusion☆21Oct 25, 2026Updated last week
- A simulator for the memory controller scheduler of a 12-core, 4.8 GHz processor using a DDR5 DIMM. It supports multiple DRAM scheduling a…☆14Dec 6, 2023Updated 2 years ago
- Official implementation of LRAgent: Efficient KV Cache Sharing for Multi-LoRA LLM Agents☆34Oct 23, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- MEMORY CENTRIC SYSTEMS FOR AI(CSI6207-01) Lecture at Yonsei(20-1)☆12Apr 6, 2022Updated 4 years ago
- ☆12Oct 9, 2025Updated last year
- TurboQuant-powered agentic AI framework for long-context LLMs on consumer hardware☆11Apr 27, 2026Updated 6 months ago
- [NeurIPS 2025] Official code repository for the paper "On Epistemic Uncertainty of Visual Tokens for Object Hallucinations in Large Visio…☆11Oct 13, 2025Updated last year
- ☆12Feb 26, 2025Updated last year
- A LLM-powered log ingestion tool.☆16Jun 28, 2026Updated 4 months ago
- ☆19Jun 14, 2026Updated 4 months ago
- Official Repo for paper "VLCache: Computing 2% Vision Tokens and Reusing 98% for Vision-Language Inference"☆16Mar 28, 2026Updated 7 months ago
- ☆17Aug 14, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Supplementary materials for "Evaluating Memory Structure in LLM Agents", work in progress.☆12Jul 28, 2026Updated 3 months ago
- Official source code for the paper "Neglected Free Lunch from Post-training: Progress Advantage for LLM Agents"☆13Oct 3, 2026Updated last month
- Chain-of-Thought Matters: Improving Long-Context Language Models with Reasoning Path Supervision☆18Apr 1, 2025Updated last year
- [ICLR 2026] KVComm: Enabling Efficient LLM Communication through Selective KV Sharing☆21Jan 26, 2026Updated 9 months ago
- InstAttention: In-Storage Attention Offloading for Cost-Effective Long-Context LLM Inference☆19Mar 30, 2025Updated last year
- ChronoQA - A Question Answering Dataset for Temporal-Sensitive Retrieval-Augmented Generation☆21Dec 26, 2025Updated 10 months ago
- [ICLR 2026🔥] SHIELD: Suppressing Hallucinations In LVLM Encoders via Bias and Vulnerability Defense☆21Mar 24, 2026Updated 7 months ago
- Code for paper "Explainable Differential Diagnosis with Dual-Inference Large Language Models"☆12Jul 13, 2025Updated last year
- FusionBrain Challenge 2.0: creating multimodal multitask model☆15Oct 29, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- T5 model optimized with FlexAttention☆14Sep 30, 2024Updated 2 years ago
- ☆11Jul 30, 2025Updated last year
- code for the paper: Beyond Appearances: Material Segmentation with Embedded Spectral Information from RGB-D imagery☆10Jun 19, 2024Updated 2 years ago
- ☆11Sep 3, 2023Updated 3 years ago
- Winner of Cloth Competition: ICRA 2023, ICRA 2024 - Center Direction Network for Grasping Point Localization on Cloths - IEEE Robotic…☆25May 2, 2026Updated 6 months ago
- [ACL 2026] Focus-dLLM: Accelerating Long-Context Diffusion LLM Inference via Confidence-Guided Context Focusing".☆14Updated this week
- AlphaDiana: A Measurement System for Agents in Verifiable Reasoning Tasks☆25Updated this week
- ☆26Apr 12, 2026Updated 6 months ago
- Scaling to Tens of Thousands of Test-Time Iterations with Loop-Native Attention Residuals☆12Oct 21, 2026Updated 2 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- The official implementation of the Paper: "UMI3D: Robust 3D Generation on Unconstrained Multi-Image Inputs via Simultaneous Focus Cross-A…☆12Jul 28, 2026Updated 3 months ago
- ☆12Jun 23, 2025Updated last year
- ☆19Aug 9, 2023Updated 3 years ago
- Persistent KV cache for multi-agent LLM systems on Apple Silicon☆18Apr 15, 2026Updated 6 months ago
- (ICML'26 Spotlight) ClinTutor-R1: Advancing Scalable and Robust One-to-Many Alignment in Clinical Socratic Education☆14May 2, 2026Updated 6 months ago
- [ICLR 2026] AgilePruner: An Empirical Study of Attention and Diversity for Adaptive Visual Token Pruning in Large Vision-Language Models☆34Oct 14, 2026Updated 3 weeks ago
- ☆10Jun 9, 2025Updated last year