MSNP1381 / cache-coolView on GitHub
🌟 Cache-cool: A fast, flexible LLM caching proxy that reduces latency and API costs by caching repetitive calls to LLM services. πŸ”„ Supports dynamic configurations, πŸ“š multiple backends (πŸŸ₯ Redis, 🟒 MongoDB, πŸ“ JSON), and πŸ—οΈ schema-specific settings.
β˜†29Aug 17, 2025Updated 6 months ago

Alternatives and similar repositories for cache-cool

Users that are interested in cache-cool are comparing it to the libraries listed below

Sorting:

Are these results useful?