Optimize vLLM with persistent system prompt caching and block reuse for faster, memory-efficient inference.
☆53Oct 6, 2025Updated 10 months ago
Alternatives and similar repositories for VLLM_PromptCache
Users that are interested in VLLM_PromptCache are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- no☆26Apr 23, 2025Updated last year
- [CVPR 2026] PromptEnhancer is a prompt-rewriting tool, refining prompts into clearer, structured versions for better image generation.☆3,750Jun 10, 2026Updated 2 months ago
- Multimodal Document Intelligence Platform☆41Apr 10, 2026Updated 4 months ago
- Res-SAM Framework for GPR Underground Hazard Detection☆1,621Jun 15, 2026Updated last month
- Synthetic Data Generation Platform By DataArcTech☆1,770Jun 30, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ECS Fargateによるエンタープライズ向けスケーラブルWebアプリケーション基盤☆22Oct 13, 2025Updated 9 months ago
- Better Auth integration for NestJS with Fastify adapter☆82Jan 21, 2026Updated 6 months ago
- LimiX: Unleashing Structured-Data Modeling Capability for Generalist Intelligence https://arxiv.org/abs/2509.03505☆3,916Jun 16, 2026Updated last month
- [ACM MM'26] 🎬 Tell the camera where to go: CT-1 understands your intent and generates videos with precise, spatially-aware camera contro…☆312Updated this week
- TVM Documentation in Chinese Simplified / TVM 中文文档☆3,887May 20, 2026Updated 2 months ago
- ☆1,076Jun 12, 2026Updated last month
- F²-Gen - A open source Financial Fraud Detection Data Generator Web Application☆368Oct 18, 2025Updated 9 months ago
- https://hcv.boyuai.com☆1,167Dec 18, 2024Updated last year
- Align Anything: Training All-modality Model with Feedback☆4,663Nov 27, 2025Updated 8 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Open-source SDK for AI-powered hand gesture interaction in XR (AR/VR), it provides the real-time hand tracking and gesture recognition th…☆381Mar 23, 2026Updated 4 months ago
- This is a database project.☆1,020Jan 4, 2026Updated 7 months ago
- ☆1,540Sep 18, 2025Updated 10 months ago
- Foundations of Medical Large Language Model Learning☆1,901May 27, 2026Updated 2 months ago
- support moe model train and monitor☆31Oct 14, 2025Updated 9 months ago
- ☆24Dec 2, 2025Updated 8 months ago
- Klavis AI: MCP integration platforms that let AI agents use tools reliably at any scale☆5,787Jun 1, 2026Updated 2 months ago
- Go bindings for the CUDA Driver and Runtime APIs, cuBLAS, and cuDNN.☆154Jul 20, 2026Updated 3 weeks ago
- ☆29May 3, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- An agent capable of self-evolving and dynamically hardening security☆2,576Jul 27, 2026Updated 2 weeks ago
- Nexent is a zero-code platform for auto-generating production-grade AI agents using Harness Engineering principles — unified tools, skill…☆5,819Updated this week
- MGCF-Net for Phishing URLs Detection☆47May 20, 2025Updated last year
- A lightweight and modular image processing pipeline written in Go. Includes utilities for cropping, resizing, watermarking, format conver…☆505Aug 20, 2025Updated 11 months ago
- Translate PDF, Word, PowerPoint, etc. | zotero翻译插件，微信扫码注册，新用户可免费翻译25万汉字或100万个英文字母。超能文献官网:suppr.wilddata.cn；☆2,011Jun 24, 2026Updated last month
- RegTool supports a wide range of software registries and package managers to enhance your development workflow.☆38Jul 23, 2024Updated 2 years ago
- ☆311Jun 16, 2026Updated last month
- ☆201Dec 4, 2025Updated 8 months ago
- ☆608Aug 3, 2026Updated last week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Easiest and laziest way for building multi-agent LLMs applications.☆3,866Updated this week
- The implementation of RAG-LER☆17Sep 19, 2025Updated 10 months ago
- HoneClaw (Hone-Financial) is dedicated to being a professional investment assistant that truly understands you.☆743Updated this week
- Repository of "Modal-NexT: toward unified heterogeneous cellular data integration"☆84Jun 16, 2025Updated last year
- ☆1,038Jun 2, 2026Updated 2 months ago
- A decentralized agent network for building collaborative, LLM-powered agent-to-agent (A2A) systems.☆566Jan 3, 2026Updated 7 months ago
- An easy-to-use vector database.☆38Apr 3, 2025Updated last year