Tool schemas get re-prefilled on every LLM request. ContextCache compiles them into a KV cache once, stores it on disk and reuses it across users and sessions — TTFT stays near 200ms with 50 tools instead of 5.6s (Qwen3-8B, RTX 3090 Ti).
☆22Sep 16, 2026Updated last month
Alternatives and similar repositories for contextcache
Users that are interested in contextcache are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MCP server for Tailscale, backed by the tailscale CLI and control-plane REST API☆14Oct 10, 2026Updated 2 weeks ago
- LLM inference in C/C++☆28Updated this week
- Universal cognitive engine for AI. Features autonomy, self-reflection, and continuous learning via the Nine Questions loop.☆14Jun 13, 2026Updated 4 months ago
- The spatial operating environment for autonomous AI agents.☆18Oct 8, 2026Updated 2 weeks ago
- ☆21Apr 21, 2026Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Near-optimal vector quantization from Google's ICLR 2026 paper — 95% recall, 5x compression, zero preprocessing, pure Python FAISS replac…☆20Mar 28, 2026Updated 6 months ago
- Minimal FlashAttention in CUDA C++/CuTe: readable WMMA/CuTe kernels, no NxN workspace, up to 4.5x faster than naive PyTorch☆29Jun 2, 2026Updated 4 months ago
- A MCP Task Server☆11Mar 7, 2025Updated last year
- Ekbasis: an open world model for agents. What an action will do, before it is done.☆19Oct 16, 2026Updated last week
- 2D autonomous car simulation in the browser, driven by TypeSafe's Jev decision model☆21Sep 18, 2026Updated last month
- ☆12Updated this week
- Rust examples for learning WebGPU☆19Updated this week
- Speculative Decoding Implementations: MTP, EAGLE-3, Medusa-1, PARD, Draft Models, N-gram and Suffix Decoding from scratch☆15May 2, 2026Updated 5 months ago
- OwlLayer AI - Open-source TypeScript Agentic UI SDK for AI-powered interfaces across React, Vue, Angular, Svelte, Vanilla JS/HTML and PHP…☆18Oct 11, 2026Updated 2 weeks ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A terminal dashboard for realtime Slurm monitoring☆23Aug 24, 2026Updated 2 months ago
- A powerful RAG system for querying code repositories using tree-sitter parsing, LanceDB vector storage, and Qwen models☆17Jun 15, 2025Updated last year
- Create the OpenAPI spec and document from dataclass, attrs, etc.☆10Oct 14, 2026Updated last week
- ☆14Oct 12, 2026Updated last week
- Your AI forgets everything between sessions. SAME fixes that. Local-first, no API keys, single binary.☆24Oct 15, 2026Updated last week
- Evidence-backed index of real-world Jev (TypeSafe AI System One) use cases: repos, patterns, benchmarks, and measured results☆19Oct 3, 2026Updated 3 weeks ago
- In this repo, I developed a step-by-step pipeline for a standard MultiSpeaker Text-to-Speech system In general, I used Portaspeech as an…☆12Nov 24, 2023Updated 2 years ago
- A Markdown annotation and highlighting plugin that tags text via a Editing-Toolbar inline, highlights it in colour, and manages notes in …☆11Sep 19, 2026Updated last month
- using STM32L4P5CGU6 and tiny usb , open source smart watch currently work in progress not finished.☆33Aug 4, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- MCP server + NinjaTrader 8 AddOn that gives an AI coding assistant eyes and a build loop for NinjaScript: compile with structured errors,…☆25Updated this week
- Coding stack built completely on local models☆21Aug 22, 2026Updated 2 months ago
- The Fresh, Minimal Flutter UI kit. Inspired by coss.com/ui, Cal.com's design system.☆64Oct 18, 2026Updated last week
- 📂 see which processes hold your files open: a smooth tui alternative to lsof/fuser with auto-refresh, fuzzy search, sort modes, and them…☆15Jul 15, 2026Updated 3 months ago
- A powerful terminal-based coding assistant that combines the convenience of a modern TUI with the intelligence of large language models. …☆14Nov 26, 2025Updated 10 months ago
- An open source native WhatsApp client writen in WXPython.☆38Updated this week
- Evolutionary algorithm for 2D guillotine cutting problem on sheets of the same size☆30Aug 31, 2026Updated last month
- A transparent (O)llama proxy with model deployment aware routing which auto-manages multiple (O)llama instances in a given network.☆20Apr 14, 2026Updated 6 months ago
- Foundational ternary-model inference & training library — CUDA + CPU, BitNet/TQ ternary kernels☆28Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆16Jun 3, 2026Updated 4 months ago
- An Ultra-Long Output Reinforcement Learning Approach☆23Jul 31, 2025Updated last year
- 📁(Dotfiles): Seraphim Shell is my personal dotfiles mainly quickshell with simple and personalize configuration for my work needs☆23Aug 20, 2026Updated 2 months ago
- ☆20May 19, 2026Updated 5 months ago
- An implementation of TinyLFU cache☆15Oct 10, 2022Updated 4 years ago
- 🍵 Simple ephemeral chat in your terminal.☆20Sep 2, 2026Updated last month
- MAZE (Massive Argumented Zonal Environments) machine learning framework☆11Mar 29, 2025Updated last year