Tool schemas get re-prefilled on every LLM request. ContextCache compiles them into a KV cache once, stores it on disk and reuses it across users and sessions — TTFT stays near 200ms with 50 tools instead of 5.6s (Qwen3-8B, RTX 3090 Ti).
☆22Sep 16, 2026Updated last month
Alternatives and similar repositories for contextcache
Users that are interested in contextcache are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AI Agent Memory System with Soul, Bonding, and Semantic Search☆27Mar 14, 2026Updated 8 months ago
- Multi-GPU (tensor-parallel) CUDA megakernel for Qwen3.8-27B GGUF (Q4_K_M, Q5_K_M, Q6_K, Q8_0) with on-device MTP speculative decoding. Fo…☆16Oct 23, 2026Updated 3 weeks ago
- Take turns on one GPU: hand it between a local LLM (e.g. Strata, driven by an agent like pi), ComfyUI and any other workload, never inter…☆13Oct 21, 2026Updated 3 weeks ago
- ☆21Apr 21, 2026Updated 6 months ago
- Fast RDF language server in Rust for Turtle, TriG, N-Triples, N-Quads and SPARQL: diagnostics, SHACL, completion, rename, formatting. VS …☆13Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A taskwarrior-style command line for Org mode's agenda: short IDs, one-line actions, and your running Emacs doing all the Org work.☆15Oct 28, 2026Updated 2 weeks ago
- Official code for AAAI2026 {Aware First, Think Less: Dynamic Boundary Self-Awareness Drives Extreme Reasoning Efficiency in Large Languag…☆13Nov 24, 2025Updated 11 months ago
- ☆11Updated this week
- A powerful RAG system for querying code repositories using tree-sitter parsing, LanceDB vector storage, and Qwen models☆19Jun 15, 2025Updated last year
- Fully local, persona-driven AI companion bot for Telegram (Telethon) with optional Discord bridge. Modular text pipeline, per-user memory…☆23Jun 21, 2026Updated 4 months ago
- Interactive course material for an undergraduate signals and systems course: step-by-step derivations, laboratories, worked problems and …☆15Updated this week
- Read-only Apple File System (APFS) implementation.☆21Aug 7, 2026Updated 3 months ago
- OwlLayer AI - Open-source TypeScript Agentic UI SDK for AI-powered interfaces across React, Vue, Angular, Svelte, Vanilla JS/HTML and PHP…☆18Oct 11, 2026Updated last month
- In this repo, I developed a step-by-step pipeline for a standard MultiSpeaker Text-to-Speech system In general, I used Portaspeech as an…☆12Nov 24, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆11May 23, 2025Updated last year
- Experimental validation: Agentic Search (context trees) vs traditional RAG for code retrieval. Agentic wins with 99% fewer tokens and 2× …☆13Jan 6, 2026Updated 10 months ago
- A Markdown annotation and highlighting plugin that tags text via a Editing-Toolbar inline, highlights it in colour, and manages notes in …☆11Sep 19, 2026Updated last month
- Pre-built BSim signature DB for 29 OSS C/C++ libraries☆17Jun 19, 2026Updated 4 months ago
- int4 transformer implementation, + custom TPU hardware design.☆14Sep 15, 2026Updated last month
- Resistor combination solver☆12Aug 21, 2026Updated 2 months ago
- An Ultra-Long Output Reinforcement Learning Approach☆23Jul 31, 2025Updated last year
- Live structural code graph for AI agents — one-curl install wires MCP + an agent skill into Claude Code, OpenCode, Codex and Cursor. Inde…☆13Oct 24, 2026Updated 3 weeks ago
- ☆14Mar 31, 2026Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Glowing 3D objects made from LED filaments. This repo holds solver, tools, webviewer and driver hardware.☆15Feb 6, 2026Updated 9 months ago
- ☆15Oct 12, 2026Updated last month
- An implementation of TinyLFU cache☆15Oct 10, 2022Updated 4 years ago
- eBPF Prometheus exporter for AI-agent activity — per-agent tools, domains, ports, files, CPU & network — with a Grafana dashboard. A yeet…☆16Oct 2, 2026Updated last month
- Pathaction - One command to run, deploy, or debug any file or directory☆19Updated this week
- A modern, cross-platform tiling terminal multiplexer that feels like a window manager - with self-arranging panes, persistent sessions, l…☆13Updated this week
- A repository of SLEIGH support for rare processor ISAs☆25Updated this week
- React-Admin Data provider to interact with Moleculer Services APIs☆14Jan 5, 2023Updated 3 years ago
- A terminal UI for browsing and inspecting vector databases☆15Apr 19, 2026Updated 6 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Super easy way to make a microscope with a DVD pickup. DVDピックアップでレーザー走査型顕微鏡を作る☆13Jan 16, 2023Updated 3 years ago
- My collection of dotfiles☆14Nov 4, 2026Updated last week
- Open quantization tooling for TurboQuant-style low-bit LLM releases, stock GGUF deployment, and Apple Silicon runtime experiments.☆10May 5, 2026Updated 6 months ago
- @fdehau does dotfiles☆14Aug 9, 2026Updated 3 months ago
- An almost-zero dependencies ASCII 3D OBJ viewer. Animations, and RGB-colored shading is supported.☆11Sep 17, 2026Updated last month
- This is the new manifest repo. The old branches are on https://github.com/DerpFest-AOSP/manifest☆15Nov 7, 2026Updated last week
- Fetch only relevant tools for the current conversation and save cost while increasing the precision of your LLM Response☆17Sep 9, 2025Updated last year
Are these results useful?