messkan / prompt-cacheLinks
Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching. A drop-in OpenAI-compatible proxy written in Go.
☆37Updated 3 weeks ago
Alternatives and similar repositories for prompt-cache
Users that are interested in prompt-cache are comparing it to the libraries listed below
Sorting:
- ☆241Updated 3 months ago
- pdfLLM is a completely open source, proof of concept RAG app.☆178Updated 3 months ago
- Run and monitor MCP servers locally☆198Updated 4 months ago
- A local private agentic system that works in your terminal.☆220Updated 3 weeks ago
- Starwise helps you manage and categorize your GitHub starred repositories using the power of AI☆134Updated 3 months ago
- Up-to-date documentation for devs and AI agents.☆340Updated last week
- API 200 is an open source API gateway to simplify 3rd-party integrations. Import endpoints, set up caching, retries, and mocks. Access al…☆247Updated 6 months ago
- A free and open documentation platform built with Laravel and Filament, enhanced by Ollama for local AI features, focused on clarity, str…☆134Updated this week
- All-in-one MCP server that can connect your AI agents to any native endpoint, powered by UTCP☆182Updated 3 weeks ago
- a project brain for your AI. Give LLMs instant architectural context without burning tokens☆245Updated last week
- ☆48Updated 10 months ago
- wanna develop an app ❓☆113Updated last month
- The Open Source Firewall for LLMs. A self-hosted gateway to secure and control AI applications with powerful guardrails.☆93Updated 5 months ago
- next-generation AI memory infrastructure (powered by mem0 and graphiti)☆163Updated last week
- A generic, modular server for implementing the Model Context Protocol (MCP).☆41Updated 4 months ago
- awesome-rag: a collection of awesome thing related to Retrieval-Augmented Generation☆171Updated 5 months ago
- A multi-agent AI architecture that connects 25+ specialized agents through n8n and MCP servers. Project NOVA routes requests to domain-sp…☆248Updated 6 months ago
- Finally, a proxy that does what grep does for logs - filters out the noise. Stop carrying 70k tokens of tools you'll never use. It's like…☆141Updated 3 weeks ago
- Turn AI into a persistent, memory-powered collaborator. Universal MCP Server (supports HTTP & STDIO) enabling cross-platform AI memory, …☆202Updated 2 weeks ago
- A CLI tool for logging and analyzing Claude Code and Cursor ai-driven coding session.☆265Updated last week
- ☆61Updated 2 months ago
- An Open Source, Claude Code Like Tool, With RAG + Graph RAG + MCP Integration, and Supports Most LLMs (Incomplete But Functional & Usable…☆123Updated 5 months ago
- A modern, AI-assisted, cross-platform database client - free☆281Updated 3 months ago
- 🕯️ A lightweight but powerful LLM chat application☆60Updated this week
- Unofficial Python client for the complete Open WebUI API.☆25Updated last week
- Station is our open-source runtime that lets teams deploy agents on their own infrastructure with full control.☆359Updated this week
- A lightweight static site generator for technical documentation.☆145Updated 3 weeks ago
- Run Claude Code within AgentFS, orchestrated by LlamaIndex Workflows☆187Updated this week
- 🚀 SuperMCP - Create multiple isolated MCP servers using a single connector. Build powerful Model Context Protocol integrations for datab…☆24Updated last week
- LogWhisperer is a self-hosted, AI-powered log summarization tool for Linux servers.☆230Updated 4 months ago