aiyuekuang / LLMProxyView on GitHub
Seamlessly route requests to your LLM backends—whether you're using stream=false for standard JSON responses or stream=true for real-time token streaming via Server-Sent Events (SSE). LLMProxy handles both modes out of the box, with zero buffering on streams, intelligent load balancing, and OpenAI-compatible API routing.
☆15Jan 30, 2026Updated 8 months ago

Alternatives and similar repositories for LLMProxy

Users that are interested in LLMProxy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?