MSNP1381 / cache-cool

🌟 Cache-cool: A fast, flexible LLM caching proxy that reduces latency and API costs by caching repetitive calls to LLM services. πŸ”„ Supports dynamic configurations, πŸ“š multiple backends (πŸŸ₯ Redis, 🟒 MongoDB, πŸ“ JSON), and πŸ—οΈ schema-specific settings.
β˜†22Updated 2 months ago

Related projects β“˜

Alternatives and complementary repositories for cache-cool