Azure-Samples / shared-azure-openai-tpm

This example shows how a multitenant service can distribute requests evenly among multiple Azure OpenAI Service instances and manage tokens per minute (TPM) for multiple tenants.
11Updated last year

Alternatives and similar repositories for shared-azure-openai-tpm:

Users that are interested in shared-azure-openai-tpm are comparing it to the libraries listed below