Tool schemas get re-prefilled on every LLM request. ContextCache compiles them into a KV cache once, stores it on disk and reuses it across users and sessions — TTFT stays near 200ms with 50 tools instead of 5.6s (Qwen3-8B, RTX 3090 Ti).
☆22Sep 16, 2026Updated 2 weeks ago
Alternatives and similar repositories for contextcache
Users that are interested in contextcache are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A single model's confident answer can still be wrong, so brainstorm-mcp runs multi-round debates between GPT, Gemini, DeepSeek, Claude, a…☆71Updated this week
- Fully local, persona-driven AI companion bot for Telegram (Telethon) with optional Discord bridge. Modular text pipeline, per-user memory…☆21Jun 21, 2026Updated 3 months ago
- Your AI forgets everything between sessions. SAME fixes that. Local-first, no API keys, single binary.☆23Sep 3, 2026Updated last month
- DAKboard opensource creation☆10Jan 9, 2023Updated 3 years ago
- A terminal UI for browsing and inspecting vector databases☆15Apr 19, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- In this repo, I developed a step-by-step pipeline for a standard MultiSpeaker Text-to-Speech system In general, I used Portaspeech as an…☆12Nov 24, 2023Updated 2 years ago
- Opinionated Elasticsearch query language for Rust☆11Jul 24, 2021Updated 5 years ago
- Python bindings for Ratatui (Rust TUI) via FFI☆19Jun 4, 2026Updated 4 months ago
- What if we wired an LLM to an HTTP server and connected it to a database and told it to be an API?☆17Jan 17, 2024Updated 2 years ago
- Add NextJS to Moleculer! 🎉☆11Jun 21, 2018Updated 8 years ago
- An Ultra-Long Output Reinforcement Learning Approach☆23Jul 31, 2025Updated last year
- A socket.io implementation over thruster☆14Mar 22, 2023Updated 3 years ago
- agent-tools is an agent-driven data utility platform that provides deterministic tools for transforming, formatting, and inspecting struc…☆19Feb 10, 2026Updated 7 months ago
- Super easy way to make a microscope with a DVD pickup. DVDピックアップでレーザー走査型顕微鏡を作る☆13Jan 16, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An implementation of TinyLFU cache☆15Oct 10, 2022Updated 3 years ago
- My collection of dotfiles☆14Apr 22, 2026Updated 5 months ago
- Rust FTL + WebRTC live streaming software.☆13Mar 12, 2022Updated 4 years ago
- Fetch only relevant tools for the current conversation and save cost while increasing the precision of your LLM Response☆17Sep 9, 2025Updated last year
- small and affordable robot, fitted in ordinary Raspberry farm lane size (less than 40 cm) to pick fresh fruit☆13Mar 29, 2020Updated 6 years ago
- Tiny evaluation of leading LLMs on competitive programming problems☆14Apr 10, 2026Updated 5 months ago
- Cron job scheduler redis module, inspired by pg_cron.☆13Mar 31, 2026Updated 6 months ago
- Personal pi agent setup☆16Mar 16, 2026Updated 6 months ago
- Load/Convert multiple GEOIP CSV databases into Redis via IP2Location format.☆11Jul 10, 2026Updated 2 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A Neural Network implemented from scratch as per http://neuralnetworksanddeeplearning.com/ in Rust. This is then trained on MNIST. This i…☆10Jul 17, 2020Updated 6 years ago
- DAKboard inspired dashboard for Home Assistant users☆17Jan 5, 2023Updated 3 years ago
- ☆10Apr 23, 2026Updated 5 months ago
- A simple model context protocol (MCP) server that allows Claude Desktop or other MCP aware clients to run Bash commands on your local mac…☆35Apr 14, 2025Updated last year
- ☆13May 12, 2022Updated 4 years ago
- Open platform for running Managed Agents at scale☆27Updated this week
- Promise wrapper for easy error handling without try-catch 💯🔥☆16Jan 3, 2023Updated 3 years ago
- Workshop showing how to get started with Generative AI APIs☆19Feb 26, 2024Updated 2 years ago
- Run an openEMS FDTD s-parameter and far-field simulation from a set of STL 3D models☆11Jul 16, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Universal unreacted hooks☆20Jan 7, 2023Updated 3 years ago
- REST module for Redis☆15Nov 10, 2022Updated 3 years ago
- [H] HyperspaceDB is a high-performance, vector database. It features 1-bit quantization, async replication, and native support for hierar…☆157Sep 8, 2026Updated 3 weeks ago
- this is based on the paper Chain-of-Retrieval Augmented Generation☆15Mar 29, 2025Updated last year
- Neural Memory Compression System for RAG Applications☆21Nov 20, 2025Updated 10 months ago
- A Write-Behind and Write-Through recipe for RedisGears using Hibernate☆10May 6, 2026Updated 4 months ago
- Solidity API contract design information for utilizing RPC/RESTful Node Interaction and GraphQL☆22Oct 5, 2021Updated 5 years ago