Tool schemas get re-prefilled on every LLM request. ContextCache compiles them into a KV cache once, stores it on disk and reuses it across users and sessions — TTFT stays near 200ms with 50 tools instead of 5.6s (Qwen3-8B, RTX 3090 Ti).
☆21Aug 18, 2026Updated last week
Alternatives and similar repositories for contextcache
Users that are interested in contextcache are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Your agent loses the plan between sessions. saga-mcp gives it a SQLite-backed tracker for projects, epics, tasks, subtasks, dependencies …☆33Aug 18, 2026Updated last week
- AI Agent Memory System with Soul, Bonding, and Semantic Search☆27Mar 14, 2026Updated 5 months ago
- Easy-to-Use, Powerful GUI-based tools for Python☆15Aug 26, 2025Updated 11 months ago
- ☆21Apr 21, 2026Updated 4 months ago
- Testing various algorithms for resolving node overlaps in a flow☆16Dec 1, 2025Updated 8 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Privacy middleware for LLM & RAG pipelines - consistent pseudonymization, encrypted vault, SSE streaming rehydration.☆39Jul 6, 2026Updated last month
- Pathaction | A universal Makefile for any file in the filesystem: Rule-driven commands for any file or directory License: GPL v3☆15Aug 17, 2026Updated last week
- Linux TUI smart file organizer with TF-IDF and local LLM classification☆20Jun 27, 2026Updated last month
- Add NextJS to Moleculer! 🎉☆11Jun 21, 2018Updated 8 years ago
- An Ultra-Long Output Reinforcement Learning Approach☆23Jul 31, 2025Updated last year
- A public repo for UI templates built using Sysinfocus simple/ui razor component library for Blazor! Check out https://blazor.art for more…☆15Apr 16, 2025Updated last year
- A socket.io implementation over thruster☆14Mar 22, 2023Updated 3 years ago
- A lightweight SQL-like database engine written from scratch in C++, featuring a hand-written tokenizer, recursive descent parser, typed t…☆22May 22, 2026Updated 3 months ago
- agent-tools is an agent-driven data utility platform that provides deterministic tools for transforming, formatting, and inspecting struc…☆19Feb 10, 2026Updated 6 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Super easy way to make a microscope with a DVD pickup. DVDピックアップでレーザー走査型顕微鏡を作る☆13Jan 16, 2023Updated 3 years ago
- An implementation of TinyLFU cache☆15Oct 10, 2022Updated 3 years ago
- My collection of dotfiles☆14Apr 22, 2026Updated 4 months ago
- Fetch only relevant tools for the current conversation and save cost while increasing the precision of your LLM Response☆17Sep 9, 2025Updated 11 months ago
- ☆17Feb 1, 2024Updated 2 years ago
- small and affordable robot, fitted in ordinary Raspberry farm lane size (less than 40 cm) to pick fresh fruit☆13Mar 29, 2020Updated 6 years ago
- Tiny evaluation of leading LLMs on competitive programming problems☆14Apr 10, 2026Updated 4 months ago
- Cron job scheduler redis module, inspired by pg_cron.☆13Mar 31, 2026Updated 4 months ago
- ☆16Dec 4, 2025Updated 8 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Load/Convert multiple GEOIP CSV databases into Redis via IP2Location format.☆11Jul 10, 2026Updated last month
- ☆10Apr 23, 2026Updated 4 months ago
- Empower your React apps with robust image/document annotation capabilities! 🚀 Supports bounding boxes, polygons, points, zooming, draggi…☆10Feb 12, 2025Updated last year
- ☆14Sep 18, 2024Updated last year
- DAKboard inspired dashboard for Home Assistant users☆17Jan 5, 2023Updated 3 years ago
- ☆13May 12, 2022Updated 4 years ago
- Run an openEMS FDTD s-parameter and far-field simulation from a set of STL 3D models☆11Jul 16, 2023Updated 3 years ago
- Workshop showing how to get started with Generative AI APIs☆19Feb 26, 2024Updated 2 years ago
- REST module for Redis☆15Nov 10, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- this is based on the paper Chain-of-Retrieval Augmented Generation☆15Mar 29, 2025Updated last year
- Solidity API contract design information for utilizing RPC/RESTful Node Interaction and GraphQL☆22Oct 5, 2021Updated 4 years ago
- A chill and fun blog about Rust stuff and the journey of building my company: Meilisearch☆13Jun 28, 2026Updated last month
- My collection of wallpapers☆16Aug 11, 2026Updated 2 weeks ago
- Meraki network topology detection and root cause analysis☆13Jan 26, 2023Updated 3 years ago
- An easy-to-use interface for io_uring☆19Feb 28, 2021Updated 5 years ago
- This is the Placeholder for Llama. Starting with Llama 3☆11May 20, 2024Updated 2 years ago