Tool schemas get re-prefilled on every LLM request. ContextCache compiles them into a KV cache once, stores it on disk and reuses it across users and sessions — TTFT stays near 200ms with 50 tools instead of 5.6s (Qwen3-8B, RTX 3090 Ti).
☆21Aug 26, 2026Updated 2 weeks ago
Alternatives and similar repositories for contextcache
Users that are interested in contextcache are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AI Agent Memory System with Soul, Bonding, and Semantic Search☆27Mar 14, 2026Updated 6 months ago
- All state — conversations, memory, config, credentials — is stored on your machine, and there is no telemetry or analytics phone-home. Yo…☆17Updated this week
- ☆16Feb 3, 2026Updated 7 months ago
- Fully local, persona-driven AI companion bot for Telegram (Telethon) with optional Discord bridge. Modular text pipeline, per-user memory…☆20Jun 21, 2026Updated 2 months ago
- Testing various algorithms for resolving node overlaps in a flow☆16Dec 1, 2025Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Privacy middleware for LLM & RAG pipelines - consistent pseudonymization, encrypted vault, SSE streaming rehydration.☆42Aug 30, 2026Updated 2 weeks ago
- Vast serverless python worker agent☆19Sep 8, 2026Updated last week
- Exploring Ultrafast machine learning on FPGAs via Kolmogorov-Arnold Networks☆17Jun 15, 2026Updated 2 months ago
- What if we wired an LLM to an HTTP server and connected it to a database and told it to be an API?☆17Jan 17, 2024Updated 2 years ago
- Machine Learning framework built from scratch in CPP. Uses tensors for base operations.☆17May 23, 2026Updated 3 months ago
- ☆21May 19, 2026Updated 3 months ago
- Add NextJS to Moleculer! 🎉☆11Jun 21, 2018Updated 8 years ago
- An Ultra-Long Output Reinforcement Learning Approach☆23Jul 31, 2025Updated last year
- Este é um agente de IA que transforma qualquer tópico de estudo em um professor IA Sênior personalizado usando o poder de qualquer LLM qu…☆18Feb 5, 2026Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A socket.io implementation over thruster☆14Mar 22, 2023Updated 3 years ago
- A Full Transcript and Slides from the talk "Attacks on Anonymity Systems: The Theory" by Len Sassaman and Roger Dingledine in 2003☆17Feb 28, 2024Updated 2 years ago
- agent-tools is an agent-driven data utility platform that provides deterministic tools for transforming, formatting, and inspecting struc…☆19Feb 10, 2026Updated 7 months ago
- An implementation of TinyLFU cache☆15Oct 10, 2022Updated 3 years ago
- Rust FTL + WebRTC live streaming software.☆13Mar 12, 2022Updated 4 years ago
- ☆17Feb 1, 2024Updated 2 years ago
- 🦉 OpenCode skill — error reflection & 5-Why root-cause learning agent☆17Sep 1, 2026Updated 2 weeks ago
- small and affordable robot, fitted in ordinary Raspberry farm lane size (less than 40 cm) to pick fresh fruit☆13Mar 29, 2020Updated 6 years ago
- Tiny evaluation of leading LLMs on competitive programming problems☆14Apr 10, 2026Updated 5 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Cron job scheduler redis module, inspired by pg_cron.☆13Mar 31, 2026Updated 5 months ago
- Personal pi agent setup☆16Mar 16, 2026Updated 5 months ago
- Load/Convert multiple GEOIP CSV databases into Redis via IP2Location format.☆11Jul 10, 2026Updated 2 months ago
- ☆10Apr 23, 2026Updated 4 months ago
- ☆14Sep 18, 2024Updated last year
- Share your content of clipboard between 2 computers!☆10Apr 3, 2018Updated 8 years ago
- Universal unreacted hooks☆20Jan 7, 2023Updated 3 years ago
- REST module for Redis☆15Nov 10, 2022Updated 3 years ago
- A Write-Behind and Write-Through recipe for RedisGears using Hibernate☆10May 6, 2026Updated 4 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Solidity API contract design information for utilizing RPC/RESTful Node Interaction and GraphQL☆22Oct 5, 2021Updated 4 years ago
- A chill and fun blog about Rust stuff and the journey of building my company: Meilisearch☆13Jun 28, 2026Updated 2 months ago
- This project aims to find arbitrage opportunities between two cryptocurrency exchanges.☆12Apr 21, 2021Updated 5 years ago
- An easy-to-use interface for io_uring☆19Feb 28, 2021Updated 5 years ago
- This is the Placeholder for Llama. Starting with Llama 3☆11May 20, 2024Updated 2 years ago
- Redis benchmark run helper☆10Sep 1, 2026Updated last week
- redis module for percentile estimation☆16Dec 26, 2019Updated 6 years ago