Optimize vLLM with persistent system prompt caching and block reuse for faster, memory-efficient inference.
☆53Oct 6, 2025Updated 10 months ago
Alternatives and similar repositories for VLLM_PromptCache
Users that are interested in VLLM_PromptCache are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- no☆26Apr 23, 2025Updated last year
- ☆21Sep 18, 2024Updated last year
- [CVPR 2026] PromptEnhancer is a prompt-rewriting tool, refining prompts into clearer, structured versions for better image generation.☆3,762Aug 18, 2026Updated last week
- Multimodal Document Intelligence Platform☆41Apr 10, 2026Updated 4 months ago
- Res-SAM Framework for GPR Underground Hazard Detection☆1,621Jun 15, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Synthetic Data Generation Platform By DataArcTech☆1,777Jun 30, 2026Updated 2 months ago
- ECS Fargateによるエンタープライズ向けスケーラブルWebアプリケーション基盤☆22Oct 13, 2025Updated 10 months ago
- Better Auth integration for NestJS with Fastify adapter☆82Jan 21, 2026Updated 7 months ago
- LimiX: Unleashing Structured-Data Modeling Capability for Generalist Intelligence https://arxiv.org/abs/2509.03505☆4,073Jun 16, 2026Updated 2 months ago
- [ACM MM'26] 🎬 Tell the camera where to go: CT-1 understands your intent and generates videos with precise, spatially-aware camera contro…☆312Aug 9, 2026Updated 3 weeks ago
- TVM Documentation in Chinese Simplified / TVM 中文文档☆3,921May 20, 2026Updated 3 months ago
- ☆1,081Jun 12, 2026Updated 2 months ago
- F²-Gen - A open source Financial Fraud Detection Data Generator Web Application☆368Oct 18, 2025Updated 10 months ago
- https://hcv.boyuai.com☆1,169Dec 18, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Align Anything: Training All-modality Model with Feedback☆4,668Nov 27, 2025Updated 9 months ago
- Open-source SDK for AI-powered hand gesture interaction in XR (AR/VR), it provides the real-time hand tracking and gesture recognition th…☆381Mar 23, 2026Updated 5 months ago
- This is a database project.☆1,020Jan 4, 2026Updated 7 months ago
- ☆1,540Sep 18, 2025Updated 11 months ago
- Foundations of Medical Large Language Model Learning☆2,127May 27, 2026Updated 3 months ago
- support moe model train and monitor☆31Oct 14, 2025Updated 10 months ago
- ☆24Dec 2, 2025Updated 8 months ago
- Klavis AI: MCP integration platforms that let AI agents use tools reliably at any scale☆5,797Jun 1, 2026Updated 2 months ago
- Go bindings for the CUDA Driver and Runtime APIs, cuBLAS, and cuDNN.☆154Jul 20, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆29May 3, 2025Updated last year
- An agent capable of self-evolving and dynamically hardening security☆2,556Jul 27, 2026Updated last month
- Nexent is a zero-code platform for auto-generating production-grade AI agents using Harness Engineering principles — unified tools, skill…☆5,841Updated this week
- MGCF-Net for Phishing URLs Detection☆47May 20, 2025Updated last year
- A lightweight and modular image processing pipeline written in Go. Includes utilities for cropping, resizing, watermarking, format conver…☆505Aug 20, 2025Updated last year
- Translate PDF, Word, PowerPoint, etc. | zotero翻译插件，微信扫码注册，新用户可免费翻译25万汉字或100万个英文字母。超能文献官网:suppr.wilddata.cn；☆2,011Updated this week
- RegTool supports a wide range of software registries and package managers to enhance your development workflow.☆38Jul 23, 2024Updated 2 years ago
- ☆311Jun 16, 2026Updated 2 months ago
- 一款开源的知识管理工具-服务端☆114Oct 20, 2025Updated 10 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆201Dec 4, 2025Updated 8 months ago
- ☆608Aug 3, 2026Updated 3 weeks ago
- Easiest and laziest way for building multi-agent LLMs applications.☆3,879Updated this week
- Enterprise-grade, local-first Agent Workbench for people and agent teams. A unified multi-engine workspace for Codex Harness, DeepSeek Ha…☆5,122Updated this week
- The implementation of RAG-LER☆17Sep 19, 2025Updated 11 months ago
- HoneClaw (Hone-Financial) is dedicated to being a professional investment assistant that truly understands you.☆746Updated this week
- Repository of "Modal-NexT: toward unified heterogeneous cellular data integration"☆84Jun 16, 2025Updated last year