Azure-Samples / azure-openai-apim-load-balancingView external linksLinks
This sample demonstrates how to load balance requests between multiple Azure OpenAI Services using Azure API Management.
☆35Apr 4, 2024Updated last year
Alternatives and similar repositories for azure-openai-apim-load-balancing
Users that are interested in azure-openai-apim-load-balancing are comparing it to the libraries listed below
Sorting:
- This example shows how a multitenant service can distribute requests evenly among multiple Azure OpenAI Service instances and manage toke…☆13Jan 9, 2024Updated 2 years ago
- Smart load balancing for OpenAI endpoints and Azure API Management☆52May 24, 2024Updated last year
- Smart load balancing for Azure OpenAI endpoints☆58Jul 3, 2024Updated last year
- This article shows how to deploy an Azure Kubernetes Service(AKS) cluster and Azure OpenAI Service via Bicep and how to deploy a Python c…☆32May 24, 2024Updated last year
- This sample shows how to create two Azure Container Apps that use OpenAI, LangChain, ChromaDB, and Chainlit using Terraform.☆12May 7, 2024Updated last year
- Help engineers to build required infrastructure with Azure OpenAI☆10May 31, 2024Updated last year
- Smart load balancing for OpenAI endpoints and Azure API Management☆98Jun 18, 2024Updated last year
- ☆183Apr 22, 2024Updated last year
- ☆50Jan 7, 2026Updated last month
- AI-Agents-Lab☆25Feb 13, 2025Updated last year
- Sample code for Gen1 to Gen2 migration patterns.☆11May 26, 2021Updated 4 years ago
- Labs to explore AI Models, MCP servers, and Agents with the AI Gateway powered by Azure API Management and Microsoft Foundry 🚀☆859Updated this week
- ☆55Jun 23, 2025Updated 7 months ago
- Azure OpenAI benchmarking tool☆151May 28, 2024Updated last year
- This sample demonstrates how to achieve Blue/Green Deployments in Azure Container Apps using Azure pipelines☆28Updated this week
- Unleash the power of Azure AI to your application developers in a secure & manageable way with Azure API Management and Azure Developer C…☆108May 16, 2025Updated 8 months ago
- ☆60Oct 9, 2024Updated last year
- Lightweight library demonstrating how to create agenting application without using any specific framework.☆27Jan 29, 2025Updated last year
- Scaling AOAI using APIM, PTUs and TPMs☆113May 17, 2024Updated last year
- Monitors and processes traffic to and from Azure OpenAI endpoints.☆109Feb 6, 2026Updated last week
- Workbook for Azure OpenAI service☆71Jan 28, 2025Updated last year
- ☆32Aug 20, 2024Updated last year
- Multi-modal & multi-domain customer service agent with real time text, voice and soon video☆76Jan 1, 2026Updated last month
- The Azure AI proxy service facilitates easy access to Azure AI resources for workshops and hackathons. It offers a Playground-like interf…☆82Oct 17, 2024Updated last year
- Azure Stream Analytics In VSCode☆11Jun 12, 2023Updated 2 years ago
- Tools to help work with bulk data when using Microsoft Purview☆14Nov 10, 2025Updated 3 months ago
- This project is able to generate Policies for Azure API Management from fluent interface written in .Net Core WebAPI application.☆11Oct 6, 2025Updated 4 months ago
- This sample describes how to deploy applications across multiple AKS clusters by using a Service Mesh (e.g., Istio)☆38Aug 14, 2023Updated 2 years ago
- A modular, beginner-to-expert guide to fine-tuning both OpenAI GPT models and open-source LLMs/SLMs on Azure - designed for technical and…☆50Dec 5, 2025Updated 2 months ago
- Template to deploy a single Data Landing Zone of the Data Management & Analytics Scenario (former Enterprise-Scale Analytics). The Data L…☆173May 22, 2024Updated last year
- Bring your data in Azure App Configuration down to your Kubernetes cluster, available as ConfigMap and Secrets and ready to be consumed b…☆10Feb 5, 2026Updated last week
- A streamlit app on credit score classification☆15Aug 8, 2022Updated 3 years ago
- ☆14Updated this week
- ☆11Dec 23, 2023Updated 2 years ago
- A centralized resource for providing baseline templates for building and deploying infrastructure-as-code best practices using Azure Bice…☆16Jun 18, 2025Updated 7 months ago
- This lab is a 1-day/2-day end-to-end SLM workshop led and developed by AI GBB. Attendees will learn how to quickly and easily perform the…☆45Jan 22, 2026Updated 3 weeks ago
- This sample allows to deploy the LiteralAI platform on azure in a few minutes. Literal AI is an observability and evaluation platform for…☆13Jul 11, 2024Updated last year
- A team of AI agents that answer document related questions (RAG alternative)☆13Apr 16, 2025Updated 9 months ago
- The goal of this repository is to accelerate Azure OpenAI service adoption and put an enterprise governance structure around it using Azu…☆12Sep 13, 2023Updated 2 years ago