Azure-Samples / shared-azure-openai-tpmLinks

This example shows how a multitenant service can distribute requests evenly among multiple Azure OpenAI Service instances and manage tokens per minute (TPM) for multiple tenants.
11Updated last year

Alternatives and similar repositories for shared-azure-openai-tpm

Users that are interested in shared-azure-openai-tpm are comparing it to the libraries listed below

Sorting: