This sample demonstrates how to load balance requests between multiple Azure OpenAI Services using Azure API Management.
☆35Apr 4, 2024Updated last year
Alternatives and similar repositories for azure-openai-apim-load-balancing
Users that are interested in azure-openai-apim-load-balancing are comparing it to the libraries listed below
Sorting:
- This example shows how a multitenant service can distribute requests evenly among multiple Azure OpenAI Service instances and manage toke…☆13Jan 9, 2024Updated 2 years ago
- Smart load balancing for OpenAI endpoints and Azure API Management☆52May 24, 2024Updated last year
- Smart load balancing for Azure OpenAI endpoints☆57Jul 3, 2024Updated last year
- This article shows how to deploy an Azure Kubernetes Service(AKS) cluster and Azure OpenAI Service via Bicep and how to deploy a Python c…☆32May 24, 2024Updated last year
- Sample chat application using Azure Cosmos DB for NoSQL, Azure OpenAI, Azure Container Apps, and Azure Container Registry☆12Apr 22, 2024Updated last year
- This sample shows how to create two Azure Container Apps that use OpenAI, LangChain, ChromaDB, and Chainlit using Terraform.☆12May 7, 2024Updated last year
- Help engineers to build required infrastructure with Azure OpenAI☆10May 31, 2024Updated last year
- Smart load balancing for OpenAI endpoints and Azure API Management☆98Jun 18, 2024Updated last year
- ☆183Apr 22, 2024Updated last year
- ☆50Jan 7, 2026Updated last month
- A calculator to estimate the number of tokens and cost associated with processing images using Azure OpenAI's multimodal models☆27Dec 16, 2025Updated 2 months ago
- AI-Agents-Lab☆25Feb 13, 2025Updated last year
- Sample code for Gen1 to Gen2 migration patterns.☆11May 26, 2021Updated 4 years ago
- Labs to explore AI Models, MCP servers, and Agents with the AI Gateway powered by Azure API Management and Microsoft Foundry 🚀☆876Feb 28, 2026Updated last week
- ☆55Jun 23, 2025Updated 8 months ago
- This project shows how to use Azure AD workload identity for Kubernetes in a .NET Standard application running on Azure Kubernetes Servic…☆26Nov 22, 2023Updated 2 years ago
- Azure OpenAI benchmarking tool☆28Apr 4, 2025Updated 11 months ago
- Azure OpenAI benchmarking tool☆151May 28, 2024Updated last year
- Unleash the power of Azure AI to your application developers in a secure & manageable way with Azure API Management and Azure Developer C…☆108May 16, 2025Updated 9 months ago
- This sample demonstrates how to achieve Blue/Green Deployments in Azure Container Apps using Azure pipelines☆28Feb 14, 2026Updated 3 weeks ago
- ☆60Oct 9, 2024Updated last year
- This sample shows how to install an AKS cluster with Azure Application Gateway for Containers via Bicep.☆24May 2, 2024Updated last year
- Scaling AOAI using APIM, PTUs and TPMs☆113May 17, 2024Updated last year
- Monitors and processes traffic to and from Azure OpenAI endpoints.☆110Updated this week
- Workbook for Azure OpenAI service☆72Jan 28, 2025Updated last year
- ☆32Aug 20, 2024Updated last year
- Multi-modal & multi-domain customer service agent with real time text, voice and soon video☆76Feb 14, 2026Updated 3 weeks ago
- Smart load balancing for Azure OpenAI endpoints☆77Apr 19, 2024Updated last year
- The Azure AI proxy service facilitates easy access to Azure AI resources for workshops and hackathons. It offers a Playground-like interf…☆82Oct 17, 2024Updated last year
- Tools to help work with bulk data when using Microsoft Purview☆14Feb 27, 2026Updated last week
- Multi-agent banking assistant with Python and Microsoft Agent Framework☆28Updated this week
- This project is able to generate Policies for Azure API Management from fluent interface written in .Net Core WebAPI application.☆11Oct 6, 2025Updated 5 months ago
- A modular, beginner-to-expert guide to fine-tuning both OpenAI GPT models and open-source LLMs/SLMs on Azure - designed for technical and…☆50Dec 5, 2025Updated 3 months ago
- This sample describes how to deploy applications across multiple AKS clusters by using a Service Mesh (e.g., Istio)☆38Aug 14, 2023Updated 2 years ago
- Template to deploy a single Data Landing Zone of the Data Management & Analytics Scenario (former Enterprise-Scale Analytics). The Data L…☆173May 22, 2024Updated last year
- Microsoft Purview - Bulk assign glossary terms, classification and asset description☆11Aug 2, 2023Updated 2 years ago
- A centralized resource for providing baseline templates for building and deploying infrastructure-as-code best practices using Azure Bice…☆16Jun 18, 2025Updated 8 months ago
- Bring your data in Azure App Configuration down to your Kubernetes cluster, available as ConfigMap and Secrets and ready to be consumed b…☆10Updated this week
- ☆11Dec 23, 2023Updated 2 years ago