Optimize vLLM with persistent system prompt caching and block reuse for faster, memory-efficient inference.
☆52Oct 6, 2025Updated last year
Alternatives and similar repositories for VLLM_PromptCache
Users that are interested in VLLM_PromptCache are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆21Sep 18, 2024Updated 2 years ago
- no☆26Apr 23, 2025Updated last year
- Code for "Nonparametric Data Attribution for Diffusion Models"☆26May 27, 2026Updated 5 months ago
- ☆13Apr 13, 2025Updated last year
- [CVPR 2026] PromptEnhancer is a prompt-rewriting tool, refining prompts into clearer, structured versions for better image generation.☆3,798Aug 18, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Multimodal Document Intelligence Platform☆42Apr 10, 2026Updated 6 months ago
- Res-SAM Framework for GPR Underground Hazard Detection☆1,622Jun 15, 2026Updated 4 months ago
- Foundations of Medical Large Language Model Learning☆2,130May 27, 2026Updated 5 months ago
- ECS Fargateによるエンタープライズ向けスケーラブルWebアプリケーション基盤☆22Oct 13, 2025Updated last year
- Synthetic Data Generation Platform By DataArcTech☆1,786Sep 9, 2026Updated last month
- ☆1,040Jun 2, 2026Updated 5 months ago
- Better Auth integration for NestJS with Fastify adapter☆83Jan 21, 2026Updated 9 months ago
- TVM Documentation in Chinese Simplified / TVM 中文文档☆3,953May 20, 2026Updated 5 months ago
- [ACM MM'26] 🎬 Tell the camera where to go: CT-1 understands your intent and generates videos with precise, spatially-aware camera contro…☆314Aug 9, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An easy-to-use vector database.☆38Apr 3, 2025Updated last year
- Assignment, homework and everything in Northeastern University Miami☆34Feb 27, 2026Updated 8 months ago
- LimiX: Unleashing Structured-Data Modeling Capability for Generalist Intelligence https://arxiv.org/abs/2609.17488☆4,403Updated this week
- ☆17Sep 20, 2021Updated 5 years ago
- F²-Gen - A open source Financial Fraud Detection Data Generator Web Application☆369Oct 18, 2025Updated last year
- 一个基于go语言实现的内存缓存，通过lru算法实现定时任务、异步任务、singleflight等内容，使用者可以基于此组件代替redis旁路由相关功能获取更好的性能☆39Jun 10, 2022Updated 4 years ago
- ☆1,083Oct 10, 2026Updated 3 weeks ago
- https://hcv.boyuai.com☆1,183Dec 18, 2024Updated last year
- ☆24Dec 2, 2025Updated 11 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Align Anything: Training All-modality Model with Feedback☆4,669Nov 27, 2025Updated 11 months ago
- 💰唯一正版💰 minerproxy minerproxy minerproxy minerproxy minerproxy minerproxy minerproxy minerproxy minerproxy minerproxy 矿池抽水 矿池代理 矿池中转 矿池抽…☆3,883Updated this week
- This is a database project.☆1,020Jan 4, 2026Updated 9 months ago
- Open-source SDK for AI-powered hand gesture interaction in XR (AR/VR), it provides the real-time hand tracking and gesture recognition th…☆381Mar 23, 2026Updated 7 months ago
- ☆1,541Sep 18, 2025Updated last year
- 数字底座是一款面向大型政府、企业数字化转型，基于身份认证、组织架构、岗位职务、应用系统、资源角色、数据目录、安全控制等功能构建的统一且安全的管理支撑平台。数字底座基于三员管理模式，具备微服务、多租户、容器化和国产化，支持用户利用代码生成器快速构建自己的业务应用，同时可关联诸…☆2,620Updated this week
- Klavis AI: MCP integration platforms that let AI agents use tools reliably at any scale☆5,830Jun 1, 2026Updated 5 months ago
- support moe model train and monitor☆31Oct 14, 2025Updated last year
- Go bindings for the CUDA Driver and Runtime APIs, cuBLAS, and cuDNN.☆155Jul 20, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Applications self-hosting and DevOps platform for running open source, web-based linux Panel of lite PaaS☆2,132Oct 27, 2026Updated last week
- RegTool supports a wide range of software registries and package managers to enhance your development workflow.☆39Jul 23, 2024Updated 2 years ago
- A lightweight and modular image processing pipeline written in Go. Includes utilities for cropping, resizing, watermarking, format conver…☆505Aug 20, 2025Updated last year
- ☆29May 3, 2025Updated last year
- An agent capable of self-evolving and dynamically hardening security☆2,585Jul 27, 2026Updated 3 months ago
- Translate PDF, Word, PowerPoint, etc. | zotero翻译插件，微信扫码注册，新用户可免费翻译25万汉字或100万个英文字母。超能文献官网:suppr.wilddata.cn；☆2,019Aug 25, 2026Updated 2 months ago
- The first open autoregressive foundational video AI model.☆2,893Oct 7, 2026Updated 3 weeks ago