Azure-Samples / shared-azure-openai-tpm
This example shows how a multitenant service can distribute requests evenly among multiple Azure OpenAI Service instances and manage tokens per minute (TPM) for multiple tenants.
☆11Updated last year
Alternatives and similar repositories for shared-azure-openai-tpm:
Users that are interested in shared-azure-openai-tpm are comparing it to the libraries listed below
- This sample demonstrates how to load balance requests between multiple Azure OpenAI Services using Azure API Management.☆34Updated 11 months ago
- This C# demo is based on azure-search-openai-demo and uses a static web app for the frontend and Azure functions for the backend API's. T…☆19Updated 2 months ago
- Build a Retrieval Augmented Generation solution using OpenAI, Azure Functions, Azure Static Web Apps, Azure SQL DB, Data API builder and …☆42Updated last month
- ☆9Updated this week
- Quickly generate embeddings from data in Azure SQL☆24Updated 2 months ago
- Workshop Azure Containers Apps☆30Updated last week
- ☆44Updated 11 months ago
- Open AI with Private Endpoints behind APIM and functionality to get tokens consumption for each consumer☆32Updated 8 months ago
- ☆37Updated 6 months ago
- Samples for Azure Functions Flex Consumption☆42Updated last month
- This sample shows how to take a ChatGPT prompt as HTTP Get or Post input, calculates the completions using OpenAI ChatGPT service, all ho…☆19Updated 3 months ago
- A repo to accelerate development and testing of GenAI Gateways built with Azure API Management. Includes various capabilities as examples…☆47Updated 2 months ago
- ☆11Updated 6 months ago
- A creative writing multi-agent solution to help users write articles using Aspire and Semantic Kernel☆42Updated last week
- Unleash the power of Azure OpenAI to your application developers in a secure & manageable way with Azure API Management and Azure Develop…☆34Updated last year
- An extension that adds support for Azure OpenAI/ OpenAI bindings in Azure Functions for LLM (GPT-3.5-Turbo, GPT-4, etc)☆88Updated this week
- ☆28Updated 4 months ago
- This repository contains a collection of Bicep modules designed to deploy a secure Azure AI Foundry environment with robust network and i…☆55Updated 3 months ago
- An "Azure Developer CLI" compatible project for deploying a set of sample resources and APIs for use with Azure API Management.☆43Updated last year
- Reference solution for how to build your own production-ready Copilot in Azure on .NET 8 using: Azure Cosmos DB and its vector database c…☆41Updated 6 months ago
- Smart load balancing for Azure OpenAI endpoints☆77Updated 11 months ago
- A variation of the Azure OpenAI chat baseline, altered to be deployed specifically into an application landing zone.☆51Updated 3 weeks ago
- Collection of advanced usage scenarios for Semantic Kernel☆17Updated this week
- Docs , samples and issues for Azure Functions on Azure Container Apps☆77Updated 2 weeks ago
- The AKS CAF Solution Factory has contents to help deployment of Kubernetes to Azure in alignment to Cloud Adoption Framework.☆28Updated 4 years ago
- The Azure Integration Migrator Tool contains the CLI tool and implementation of the plug-in architecture. It converts command line optio…☆49Updated 9 months ago
- Workbook for Azure OpenAI service☆65Updated 2 months ago
- Details regarding the customer-ready Dapr workshop created by the Microsoft Cloud Native Global Black Belt Team☆30Updated 2 years ago
- Durable Multi Agents is an attempt to make use of Azure Durable Functions with Semantic Kernel to build Multi-Agents workflows.☆37Updated last week
- ☆38Updated last week