Pi compaction that reuses the server's prefix cache (vLLM / SGLang / llama.cpp Anthropic endpoints): no cold re-prefill, plus a warm-up so the next turn starts from cache
☆20Oct 16, 2026Updated this week
Alternatives and similar repositories for pi-prefix-cache-compaction
Users that are interested in pi-prefix-cache-compaction are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Web search tool for the pi coding agent — batch queries, ranked readable markdown results ready to fetch. Pairs with pi-smart-fetch.☆23Oct 10, 2026Updated last week
- Losslessly compress the tool output your AI agent sends the model, prove every value survived, and report the exact tokens removed. Run i…☆39Aug 5, 2026Updated 2 months ago
- A pi extension that adds a /for-$each prompt loop – and hides it from your LLM! Supports children-in-directory and line-in-files iteratio…☆18Oct 3, 2026Updated 2 weeks ago
- Automated literature reviews using local LLMs via Ollama. Searches academic databases, acquires full-text papers, and writes APA 7th revi…☆39Sep 9, 2026Updated last month
- When Claude says “tests pass”, makoto checks the record — every claim held against the agent's own logged deeds; fakes blocked, not warne…☆45Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Pi coding agent extension for focused code retrieval, grounded edits, safety checks, and language-server support.☆28Sep 23, 2026Updated 3 weeks ago
- Chrome side-panel UI and local bridge extension for Pi Coding Agent☆17Aug 2, 2026Updated 2 months ago
- A tiny pi.dev extension that replaces the default context meter with a compact segmented bar under the editor☆15May 7, 2026Updated 5 months ago
- Single-file, zero-dependency task board: owner-vs-agent plates, a dependency map, tap-to-complete.☆103Jul 24, 2026Updated 2 months ago
- Unified surface to list, toggle, group, and focus tools from any Pi extension (including MCP), with active context-cost tracking. State p…☆37Oct 8, 2026Updated last week
- Self-hosted LLM security proxy. PII redaction, prompt injection defense, KVKK/GDPR/PCI-DSS compliance. Sub-millisecond latency☆44Updated this week
- Craft your own Pi client while it runs. Enhance your pi workflows with HTML functionalities. Have fun :)☆128Aug 29, 2026Updated last month
- local cli for ai coding cost control. scans your repo, finds token waste, and generates smaller context packs for claude code, cursor, co…☆21Jul 2, 2026Updated 3 months ago
- An operating system for LLM inference that makes the most of your hardware: generate optimized compute, run models beyond available memor…☆47Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- RouteWeaver: experimental cache-safe speculative inference and CPU/GPU transfer optimization for Qwen 27B on low-VRAM NVIDIA GPUs.☆32Oct 10, 2026Updated last week
- This repo is a alternative solution for standard self-attention. It uses tree routing with learnable functions for cheaper self-attention…☆39Oct 11, 2026Updated last week
- Whole-disk file search for Windows: any file by name in a millisecond, search inside your files, a search bar on Alt+Shift+Space and a tr…☆19Updated this week
- NotebookLM on steroids — purpose-built for security researchers.☆29Jun 15, 2026Updated 4 months ago
- A guide to setting up Home Assistant to run water-based underfloor heating☆13Mar 30, 2025Updated last year
- ☆16Jun 29, 2026Updated 3 months ago
- An agentic runtime that enables secure, extensible and configurable AI automation from any model☆17Updated this week
- Port of Alex's Mobs to Fabric. Has some changes for Crimecraft S3, so don't expect this to be 1:1.☆12Oct 5, 2026Updated 2 weeks ago
- l3ms - local large language (l3) models - running and orchestrating models locally☆17Oct 7, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Run software that was never built for your computer.☆16Oct 13, 2026Updated last week
- Open-source deep-work orchestrator: a frontier planner proposes one small epoch at a time; local models grind; deterministic gates verify…☆41Jul 11, 2026Updated 3 months ago
- Write commit messages, grep by meaning, turn English into shell — small composable CLI tools backed by an LLM. Local by default (no API k…☆37Aug 14, 2026Updated 2 months ago
- Zero-Trust runtime authorization for OpenClaw agents. Block prompt injection and unauthorized tool calls before execution.☆24Mar 14, 2026Updated 7 months ago
- Windows Hardware Diagnostic & Local AI Model Advisor. Fast in-process hardware detection & intelligent local LLM recommender for Ollama.☆36Sep 1, 2026Updated last month
- SIGVERN RF (formerly OpenRF Platform) — Open-source ESP32-S3 RF gateway with dual CC1101 radios, 433/868 MHz support, protocol decoding, …☆65Updated this week
- An elegant, information-rich status, menu, and side bar for Pi Agent.☆373Updated this week
- Deterministic, read-only static auditor for GGUF models: behavioral chat-template backdoors + SSTI, tokenizer, config, and model-card sur…☆28Oct 1, 2026Updated 2 weeks ago
- Visual-first architecture workspace with typed graphs, deterministic validation, semantic diffs, and proposal-gated AI changes.☆16Aug 27, 2026Updated last month
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Claude - Production LLM Runtime Alignment Context Injection☆14Sep 19, 2026Updated last month
- Sort your tabs using Firefox's local AI but make it look awesome! Includes ATG install.☆30Aug 24, 2026Updated last month
- Salt encrypts your agent's files and database memories before they leave your machine.☆28Oct 13, 2026Updated last week
- A 4B decision model: calibrated probabilities for yes/no, choice and score questions over long inputs.☆38Oct 12, 2026Updated last week
- Zero-shot clone-tuner for Kokoro-82M. Generate stock-compatible custom voice packs from 5-seconds of reference audio in less than 1-secon…☆18Updated this week
- LLM inference in C/C++☆42Updated this week
- Make short product films from your product's real UI with AI coding agents.☆30Oct 5, 2026Updated 2 weeks ago