messkan / prompt-cacheLinks
Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching. A drop-in OpenAI-compatible proxy written in Go.
☆34Updated this week
Alternatives and similar repositories for prompt-cache
Users that are interested in prompt-cache are comparing it to the libraries listed below
Sorting:
- ☆238Updated 2 months ago
- Up-to-date documentation for devs and AI agents.☆317Updated 3 weeks ago
- API 200 is an open source API gateway to simplify 3rd-party integrations. Import endpoints, set up caching, retries, and mocks. Access al…☆246Updated 6 months ago
- Run and monitor MCP servers locally☆198Updated 3 months ago
- next-generation AI memory infrastructure (powered by mem0 and graphiti)☆163Updated 3 months ago
- pdfLLM is a completely open source, proof of concept RAG app.☆174Updated 2 months ago
- All-in-one MCP server that can connect your AI agents to any native endpoint, powered by UTCP☆167Updated 2 weeks ago
- ⚡ A lightweight, self-hosted YouTube video summarizer with Gemini AI☆214Updated last week
- A multi-agent AI architecture that connects 25+ specialized agents through n8n and MCP servers. Project NOVA routes requests to domain-sp…☆241Updated 5 months ago
- Finally, a proxy that does what grep does for logs - filters out the noise. Stop carrying 70k tokens of tools you'll never use. It's like…☆136Updated this week
- A local private agentic system that works in your terminal.☆218Updated last month
- ☆48Updated 9 months ago
- Extract any website’s full design system in few seconds - colors, typography, spacing, shadows, breakpoints. One command.☆247Updated this week
- High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model di…☆119Updated this week
- Alice is a voice-first desktop AI assistant application built with Vue.js, Vite, and Electron. Advanced memory system, function calling, …☆199Updated last week
- awesome-rag: a collection of awesome thing related to Retrieval-Augmented Generation☆164Updated 4 months ago
- OLLama IMage CAtegorizer☆70Updated 10 months ago
- Open Source Locally Hosted Lovable with Full Stack Support☆206Updated 3 weeks ago
- mcp manager, add & syncs MCP server configurations across clients like Claude, Cursor💡 build-in Codex agent☆233Updated this week
- Starwise helps you manage and categorize your GitHub starred repositories using the power of AI☆132Updated 2 months ago
- VUDA is an autonomous debugging agent that empowers AI models to visually analyze, test, and debug web☆72Updated 4 months ago
- An open-source Text2SQL tool that transforms natural language into SQL using graph-powered schema understanding. Ask your database questi…☆248Updated this week
- The easiest to use platform for browser-use agents.☆251Updated this week
- Powerful search page powered by LLMs and SearXNG☆264Updated last month
- A lightweight UI for chatting with Ollama models. Streaming responses, conversation history, and multi-model support.☆142Updated 8 months ago
- Your own Gen UI platform. Create components or whole frontend with your fav LLM☆91Updated 2 weeks ago
- Deep Research for Code & Files☆262Updated this week
- Iterative development framework combining Domain-Driven Design with Agile philosophy☆35Updated last week
- A modern, AI-assisted, cross-platform database client - free☆274Updated 2 months ago
- A lightweight static site generator for technical documentation.☆143Updated 2 weeks ago