This sample demonstrates how to load balance requests between multiple Azure OpenAI Services using Azure API Management.
☆35Apr 4, 2024Updated 2 years ago
Alternatives and similar repositories for azure-openai-apim-load-balancing
Users that are interested in azure-openai-apim-load-balancing are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This example shows how a multitenant service can distribute requests evenly among multiple Azure OpenAI Service instances and manage toke…☆14Jan 9, 2024Updated 2 years ago
- Smart load balancing for OpenAI endpoints and Azure API Management☆51May 24, 2024Updated 2 years ago
- Smart load balancing for Azure OpenAI endpoints☆58Jul 3, 2024Updated 2 years ago
- This project shows how to use Azure AD workload identity for Kubernetes in a .NET Standard application running on Azure Kubernetes Servic…☆27Nov 22, 2023Updated 2 years ago
- This article shows how to deploy an Azure Kubernetes Service(AKS) cluster and Azure OpenAI Service via Bicep and how to deploy a Python c…☆32May 24, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆182Apr 22, 2024Updated 2 years ago
- This sample shows how to create two Azure Container Apps that use OpenAI, LangChain, ChromaDB, and Chainlit using Terraform.☆11May 7, 2024Updated 2 years ago
- Sample chat application using Azure Cosmos DB for NoSQL, Azure OpenAI, Azure Container Apps, and Azure Container Registry☆12Apr 22, 2024Updated 2 years ago
- lps-docs☆13Jul 21, 2026Updated last week
- Smart load balancing for OpenAI endpoints and Azure API Management☆100Jun 18, 2024Updated 2 years ago
- ☆52Jan 7, 2026Updated 6 months ago
- ☆54Jun 23, 2025Updated last year
- Help engineers to build required infrastructure with Azure OpenAI☆10May 31, 2024Updated 2 years ago
- ☆15Jun 25, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆16Jun 11, 2026Updated last month
- ☆10Jun 1, 2022Updated 4 years ago
- Labs to explore AI Models, MCP servers, and Agents with the AI Gateway powered by Azure API Management and Microsoft Foundry 🚀☆961Updated this week
- Bring your data in Azure App Configuration down to your Kubernetes cluster, available as ConfigMap and Secrets and ready to be consumed b…☆11Updated this week
- This sample describes how to deploy applications across multiple AKS clusters by using a Service Mesh (e.g., Istio)☆38Aug 14, 2023Updated 2 years ago
- This sample demonstrates how to achieve Blue/Green Deployments in Azure Container Apps using Azure pipelines☆28Feb 14, 2026Updated 5 months ago
- This sample shows how to install an AKS cluster with Azure Application Gateway for Containers via Bicep.☆26May 2, 2024Updated 2 years ago
- AI-Agents-Lab☆25Feb 13, 2025Updated last year
- Scaling AOAI using APIM, PTUs and TPMs☆114May 17, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Smart load balancing for Azure OpenAI endpoints☆77Apr 19, 2024Updated 2 years ago
- Deploy APIM. Auto-configure it to work with your Azure Open AI.☆115Mar 30, 2026Updated 3 months ago
- A sample demo for building and testing react components and includes a set of unique features including AI component generation and autom…☆17Jun 27, 2024Updated 2 years ago
- ☆14Jul 1, 2026Updated 3 weeks ago
- Unleash the power of Azure AI to your application developers in a secure & manageable way with Azure API Management and Azure Developer C…☆113May 20, 2026Updated 2 months ago
- Multi-modal & multi-domain customer service agent with real time text, voice and soon video☆78Feb 14, 2026Updated 5 months ago
- This repository shows and compares four different techniques an AKS-hosted workload can use to access secrets from an Azure Key Vault res…☆14Mar 12, 2025Updated last year
- The goal of this repository is to accelerate Azure OpenAI service adoption and put an enterprise governance structure around it using Azu…☆12Sep 13, 2023Updated 2 years ago
- ☆17Jul 11, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- This is an end-to-end demo showing the power of LLM on top of Azure Data Manager for Energy data☆13Apr 3, 2024Updated 2 years ago
- This sample shows how to use Bicep to create an Azure Private Link Service that can be accessed by a third party via an Azure Private End…☆11Jul 1, 2022Updated 4 years ago
- ☆16Dec 16, 2025Updated 7 months ago
- This lab is a 1-day/2-day end-to-end SLM workshop led and developed by AI GBB. Attendees will learn how to quickly and easily perform the…☆46Jan 22, 2026Updated 6 months ago
- TFLint ruleset for Azure Verified Modules☆16Apr 24, 2026Updated 3 months ago
- The Azure AI proxy service facilitates easy access to Azure AI resources for workshops and hackathons. It offers a Playground-like interf…☆84Mar 9, 2026Updated 4 months ago
- This sample shows how to install an AKS cluster with the Istio service mesh add-on via Bicep.☆13Apr 21, 2023Updated 3 years ago