Azure-Samples / shared-azure-openai-tpmView on GitHub
This example shows how a multitenant service can distribute requests evenly among multiple Azure OpenAI Service instances and manage tokens per minute (TPM) for multiple tenants.
13Jan 9, 2024Updated 2 years ago

Alternatives and similar repositories for shared-azure-openai-tpm

Users that are interested in shared-azure-openai-tpm are comparing it to the libraries listed below

Sorting:

Are these results useful?