Optimize vLLM with persistent system prompt caching and block reuse for faster, memory-efficient inference.
☆53Oct 6, 2025Updated 9 months ago
Alternatives and similar repositories for VLLM_PromptCache
Users that are interested in VLLM_PromptCache are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- no☆26Apr 23, 2025Updated last year
- ☆21Sep 18, 2024Updated last year
- [CVPR 2026] PromptEnhancer is a prompt-rewriting tool, refining prompts into clearer, structured versions for better image generation.☆3,729Jun 10, 2026Updated last month
- Multimodal Document Intelligence Platform☆41Apr 10, 2026Updated 3 months ago
- Res-SAM Framework for GPR Underground Hazard Detection☆1,620Jun 15, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Synthetic Data Generation Platform By DataArcTech☆1,758Jun 30, 2026Updated 3 weeks ago
- ECS Fargateによるエンタープライズ向けスケーラブルWebアプリケーション基盤☆22Oct 13, 2025Updated 9 months ago
- ☆29May 3, 2025Updated last year
- Better Auth integration for NestJS with Fastify adapter☆82Jan 21, 2026Updated 6 months ago
- LimiX: Unleashing Structured-Data Modeling Capability for Generalist Intelligence https://arxiv.org/abs/2509.03505☆3,816Jun 16, 2026Updated last month
- [ACM MM'26] 🎬 Tell the camera where to go: CT-1 understands your intent and generates videos with precise, spatially-aware camera contro…☆309Jul 13, 2026Updated last week
- TVM Documentation in Chinese Simplified / TVM 中文文档☆3,854May 20, 2026Updated 2 months ago
- Metrics for Go — lightweight, concurrent-safe, and with built-in support for exporting Counters, Gauges, and Timers to DataDog via DogSta…☆41Jun 8, 2025Updated last year
- ☆883Jun 12, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- F²-Gen - A open source Financial Fraud Detection Data Generator Web Application☆368Oct 18, 2025Updated 9 months ago
- The implementation of RAG-LER☆17Sep 19, 2025Updated 10 months ago
- https://hcv.boyuai.com☆1,164Dec 18, 2024Updated last year
- Open-source SDK for AI-powered hand gesture interaction in XR (AR/VR), it provides the real-time hand tracking and gesture recognition th…☆382Mar 23, 2026Updated 3 months ago
- This is a database project.☆1,020Jan 4, 2026Updated 6 months ago
- ☆1,541Sep 18, 2025Updated 10 months ago
- Foundations of Medical Large Language Model Learning☆1,684May 27, 2026Updated last month
- support moe model train and monitor☆31Oct 14, 2025Updated 9 months ago
- ☆26Dec 2, 2025Updated 7 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Klavis AI: MCP integration platforms that let AI agents use tools reliably at any scale☆5,771Jun 1, 2026Updated last month
- Go bindings for the CUDA Driver and Runtime APIs, cuBLAS, and cuDNN.☆154Updated this week
- An agent capable of self-evolving and dynamically hardening security☆2,475May 25, 2026Updated last month
- Nexent is a zero-code platform for auto-generating production-grade AI agents using Harness Engineering principles — unified tools, skill…☆5,745Updated this week
- MGCF-Net for Phishing URLs Detection☆47May 20, 2025Updated last year
- A lightweight and modular image processing pipeline written in Go. Includes utilities for cropping, resizing, watermarking, format conver…☆505Aug 20, 2025Updated 11 months ago
- Translate PDF, Word, PowerPoint, etc. | zotero翻译插件，微信扫码注册，新用户可免费翻译25万汉字或100万个英文字母。超能文献官网:suppr.wilddata.cn；☆2,007Jun 24, 2026Updated 3 weeks ago
- RegTool supports a wide range of software registries and package managers to enhance your development workflow.☆38Jul 23, 2024Updated last year
- ☆291Jun 16, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆201Dec 4, 2025Updated 7 months ago
- 一款开源的知识管理工具-服务端☆112Oct 20, 2025Updated 9 months ago
- ☆21Jun 8, 2025Updated last year
- ☆608Updated this week
- Easiest and laziest way for building multi-agent LLMs applications.☆3,855Updated this week
- HoneClaw (Hone-Financial) is dedicated to being a professional investment assistant that truly understands you.☆742Updated this week
- 一个基于go语言实现的内存缓存，通过lru算法实现定时任务、异步任务、singleflight等内容，使用者可以基于此组件代替redis旁路由相关功能获取更好的性能☆39Jun 10, 2022Updated 4 years ago