Azure-Samples / azure-openai-apim-load-balancing

This sample demonstrates how to load balance requests between multiple Azure OpenAI Services using Azure API Management.
34Updated last year

Alternatives and similar repositories for azure-openai-apim-load-balancing:

Users that are interested in azure-openai-apim-load-balancing are comparing it to the libraries listed below