MSNP1381 / cache-cool

🌟 Cache-cool: A fast, flexible LLM caching proxy that reduces latency and API costs by caching repetitive calls to LLM services. 🔄 Supports dynamic configurations, 📚 multiple backends (🟥 Redis, 🟢 MongoDB, 📁 JSON), and 🏗️ schema-specific settings.
23Updated 4 months ago

Alternatives and similar repositories for cache-cool:

Users that are interested in cache-cool are comparing it to the libraries listed below