danielebruneo / KeepRoLLMingView on GitHub
OpenAI-compatible proxy that makes local LLMs serving easy and reliable. Sits between your client and any OpenAI-compatible backend, adding routing, pooling, sticky sessions, fallback, loop detection and context window management.
☆13Oct 19, 2026Updated 2 weeks ago

Alternatives and similar repositories for KeepRoLLMing

Users that are interested in KeepRoLLMing are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?