Smart OpenAI‑compatible proxy for llama.cpp: manages slots, saves/restores KV cache to disk, routes requests by prefix similarity, and protects hot slots from being overwritten. Accelerates long prompts (30–60k tokens) via instant reuse or fast on‑demand restore; supports SSE streaming and non‑stream JSON over /v1/chat/completions.
☆38Nov 14, 2025Updated 5 months ago
Alternatives and similar repositories for proxycache
Users that are interested in proxycache are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM backed Fantasy Tribe Game☆19Nov 21, 2024Updated last year
- Proxy for OpenAI☆16Sep 2, 2025Updated 7 months ago
- Fork of "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching"☆17Nov 27, 2024Updated last year
- Skills for creating high quality skills and agents☆119Apr 5, 2026Updated last week
- Vercel AI SDK community provider for OpenCode SDK - Use OpenCode configured providers via SDK☆79Mar 24, 2026Updated 3 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- world's stupidest moe llm in 103M parameters☆20Jul 18, 2025Updated 8 months ago
- ☆29Nov 5, 2024Updated last year
- ☆16Jun 16, 2024Updated last year
- Dynamic Swagger UI for frappe Apps☆20Sep 30, 2024Updated last year
- TaskFlowAI is a lightweight and flexible framework designed for creating AI-driven task pipelines and multi-agent workflows. It provides …☆17Nov 18, 2024Updated last year
- Awesome AI Benchmarks☆29Jan 16, 2026Updated 3 months ago
- ☆15Apr 3, 2025Updated last year
- IceCash. Касса Linux. Рабочее место кассира под linux с использованием web интерфейса. С драйвером к Штрих-М ФРК.☆25Jun 9, 2015Updated 10 years ago
- AdaLLM is an NVFP4-first inference runtime for Ada Lovelace (RTX 4090) with FP8 KV cache and custom decode kernels. This repo targets NVF…☆109Feb 15, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- a frappe app for my medium post☆15Jun 19, 2024Updated last year
- Scripts and tools for optimizing quantizations in llama.cpp with GGUF imatrices.☆19Jan 10, 2025Updated last year
- A list WebGL/WebGPU/WebXR of libraries and frameworks.☆21Jan 3, 2024Updated 2 years ago
- ☆24Mar 26, 2026Updated 3 weeks ago
- MCP (Model Context Protocol) server for Listmonk newsletter management☆27Jan 13, 2026Updated 3 months ago
- Temporal is a library of useful Date and Time functions (plus a Redis database) that can be integrated with other Frappe framework applic…☆15Dec 5, 2025Updated 4 months ago
- a .net port of GhostCursor https://github.com/Xetera/ghost-cursor☆12May 30, 2021Updated 4 years ago
- Gives realtime and asynchronous feedback to parts created in the FreeCAD Part Design and Sketcher workbenches.☆18Dec 29, 2024Updated last year
- ☆11Nov 10, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An OpenSource implementation of remixicon for React Native☆41Nov 11, 2025Updated 5 months ago
- ☆17Dec 16, 2024Updated last year
- Connect Channel Messenger, Zalo, Viber, Skype, Telegram☆12Nov 5, 2018Updated 7 years ago
- Downloads books from the amazon web reader☆30Oct 15, 2025Updated 6 months ago
- Publish updates to several social networks simultaneously☆16Apr 12, 2015Updated 11 years ago
- KodiPlay☆12Apr 4, 2023Updated 3 years ago
- Feature board for ERPNext☆18Mar 17, 2022Updated 4 years ago
- Build custom ReST api's on top of Frappe☆22Nov 25, 2021Updated 4 years ago
- Docker image for Mojolicious☆16Oct 10, 2025Updated 6 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- First-class state management via state machines☆66Jul 16, 2016Updated 9 years ago
- ☆17Sep 28, 2021Updated 4 years ago
- 📧 Never end in spam with the world's most comprehensive email deliverability checklist☆24May 10, 2024Updated last year
- Cloud service management and operation repository for reference archtiecture☆16Jul 28, 2019Updated 6 years ago
- LLM based file organizer☆31Mar 24, 2023Updated 3 years ago
- live transcription in Rust☆61Apr 8, 2026Updated last week
- ERPNext App - Calendar way to plan Job Card☆20Mar 25, 2025Updated last year