Cross-model KV cache transfer in vLLM: a smaller model prefills, a bigger one answers from its cache (independent implementation of arXiv:2608.03893, measured on 2x RTX 3090)
☆19Aug 10, 2026Updated 2 months ago
Alternatives and similar repositories for vllm-cross-model-kv
Users that are interested in vllm-cross-model-kv are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Algorithm-System Co-design: accurate and efficient 2-bit KV cache quantization for LLM Inference.☆23May 20, 2026Updated 5 months ago
- OCR normalization (Article repo)☆20Oct 21, 2025Updated last year
- ☆17Jun 14, 2026Updated 4 months ago
- ☆14Aug 21, 2026Updated 2 months ago
- Open-source vulnerability prioritization engine that enriches scanner findings with vulnerability intelligence, identifies urgent risks, …☆37Aug 20, 2026Updated 2 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A client for the Overmind - an end-to-end agent optimisation platform☆14Apr 30, 2026Updated 5 months ago
- Chat web application for learning e2e automation with Playwright☆50Updated this week
- [EMNLP 2025🔥] UNComp: Can Matrix Entropy Uncover Sparsity? -- A Compressor Design from an Uncertainty-Aware Perspective☆20Jan 7, 2026Updated 9 months ago
- KV cache compression via sparse coding☆18Oct 26, 2025Updated last year
- Lighthouse for MCP — score any MCP server 0–100.☆42Updated this week
- Mimic: lightweight browser automation without Chromium. JavaScript automation and web scraping with Playwright, Puppeteer and CDP. Source…☆36Oct 18, 2026Updated last week
- Turns any OpenAPI/Swagger API into an MCP server. One MCP tool per endpoint, Streamable HTTP - for AI clients calling your REST API.☆16Feb 21, 2026Updated 8 months ago
- Declarative filtration, database level validation and other features for FastAPI + Async SQLAlchemy applications☆16Sep 29, 2026Updated 3 weeks ago
- 📚 Plug-and-play blog engine for Phoenix with Editor.js integration.☆20Jun 10, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Python TCP server for terminal rickrolls☆13Nov 23, 2021Updated 4 years ago
- Simple p2p messenger using udp, websocket, tview.☆22Jul 10, 2022Updated 4 years ago
- A desktop application powered by Phoenix LiveView and Tauri.☆24Apr 22, 2026Updated 6 months ago
- orbital MCMC☆10Jun 17, 2021Updated 5 years ago
- ☆16Mar 5, 2026Updated 7 months ago
- 3D Graphics for Windows Desktop☆14Oct 25, 2013Updated 13 years ago
- ☆16Jun 4, 2024Updated 2 years ago
- PyTorch implementation of CVPR 2020 paper (Reference-Based Sketch Image Colorization using Augmented-Self Reference and Dense Semantic Co…☆17Oct 10, 2021Updated 5 years ago
- Simple audio AE☆13Nov 10, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Implementation for IceCache: Memory-Efficient KV-cache Management for Long-Sequence LLMs (ICLR 2026).☆25Jun 9, 2026Updated 4 months ago
- ☆13Feb 27, 2024Updated 2 years ago
- Predictable by contract — HTAP database engine in Rust☆12Jun 29, 2026Updated 3 months ago
- ☆23Aug 24, 2026Updated 2 months ago
- ☆37Apr 6, 2019Updated 7 years ago
- Real time chat with socket.io and Node.js☆12Aug 27, 2026Updated last month
- The tensor-network translation module for Qibo.☆16Updated this week
- LangXAI: Integrating Large Vision Models for Generating Textual Explanations to Enhance Explainability in Visual Perception Tasks☆19Oct 3, 2024Updated 2 years ago
- Datasets in kazakh language for different tasks☆65Oct 4, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Presentation on Human-Level Control Through Deep Reinforcement Learning☆13Feb 28, 2016Updated 10 years ago
- LLM Benchmark Using Project Euler For Coding Challenges☆15Updated this week
- In this repository, I have explained the working of the Transformer architecture, provided the code for building it from scratch, and dem…☆15Jun 11, 2024Updated 2 years ago
- Embedded Lightpanda for Python - a lightweight browser with CDP support☆12May 5, 2026Updated 5 months ago
- ☆122May 29, 2026Updated 4 months ago
- Script auto click đánh giá môn học và tính điểm trung bình tích lũy CPA/GPA trên portal HCMUS.☆15Aug 14, 2024Updated 2 years ago
- The Facial Recognition Based Attendance System is an automated solution designed to streamline attendance management in educational insti…☆16Apr 5, 2026Updated 6 months ago