This sample demonstrates how to load balance requests between multiple Azure OpenAI Services using Azure API Management.
☆35Apr 4, 2024Updated 2 years ago
Alternatives and similar repositories for azure-openai-apim-load-balancing
Users that are interested in azure-openai-apim-load-balancing are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This example shows how a multitenant service can distribute requests evenly among multiple Azure OpenAI Service instances and manage toke…☆14Jan 9, 2024Updated 2 years ago
- Smart load balancing for Azure OpenAI endpoints☆58Jul 3, 2024Updated 2 years ago
- Smart load balancing for OpenAI endpoints and Azure API Management☆51May 24, 2024Updated 2 years ago
- Help engineers to build required infrastructure with Azure OpenAI☆10May 31, 2024Updated 2 years ago
- ☆182Apr 22, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆52Jan 7, 2026Updated 9 months ago
- This is an end-to-end demo showing the power of LLM on top of Azure Data Manager for Energy data☆13Apr 3, 2024Updated 2 years ago
- A sample demo for building and testing react components and includes a set of unique features including AI component generation and autom…☆17Jun 27, 2024Updated 2 years ago
- This article provides a comprehensive guide on utilizing Harbor as a container registry in a multi-region and multi-cloud setup with Azur…☆11Dec 18, 2023Updated 2 years ago
- This project demonstrates the process of deploying Kaito on AKS using Terraform, creating a Falcon 7B Instruct model hosted on AKS using …☆14Mar 19, 2025Updated last year
- This project shows how to use Azure AD workload identity for Kubernetes in a .NET Standard application running on Azure Kubernetes Servic…☆27Nov 22, 2023Updated 2 years ago
- This sample shows how to install an AKS cluster with Azure Application Gateway for Containers via Bicep.☆26May 2, 2024Updated 2 years ago
- This sample shows how to create two Azure Container Apps that use OpenAI, LangChain, ChromaDB, and Chainlit using Terraform.☆11May 7, 2024Updated 2 years ago
- E2E ready to deploy solution architecture combining Cognitive (Enterprise) Search with OpenAI to search for relevant information and then…☆27Jul 6, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Smart load balancing for Azure OpenAI endpoints☆77Apr 19, 2024Updated 2 years ago
- ☆41Nov 29, 2023Updated 2 years ago
- This sample shows how to create two Azure Container Apps that use OpenAI, LangChain, ChromaDB, and Chainlit using Terraform.☆156May 7, 2024Updated 2 years ago
- Repository for workshop on building custom copilot extensions☆10Nov 8, 2024Updated last year
- A walkthrough on using Azure OpenAI and Azure API Management Service to implement load balancing, retry implementation, and logging.☆12Feb 2, 2024Updated 2 years ago
- ☆55Jun 23, 2025Updated last year
- A cross platform application to automate the process of migrating Apigee proxies to Azure API Management☆22Jun 11, 2024Updated 2 years ago
- Smart load balancing for OpenAI endpoints and Azure API Management☆99Aug 23, 2026Updated 2 months ago
- ☆15Jun 25, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Labs to explore AI Models, MCP servers, and Agents with the AI Gateway powered by Azure API Management and Microsoft Foundry 🚀☆1,007Sep 16, 2026Updated last month
- ☆16Aug 12, 2026Updated 2 months ago
- This sample shows how to take a ChatGPT prompt as HTTP Get or Post input, calculates the completions using OpenAI ChatGPT service, all ho…☆21May 28, 2026Updated 5 months ago
- Simple starting point function to host LangChains with LLMs and other tools in an Azure Function.☆73May 28, 2026Updated 5 months ago
- AI Shopping Cart - Sample Application with Azure OpenAI and Azure Spring Apps☆22Aug 14, 2024Updated 2 years ago
- Query data from data lake in natural language: LLMs + Chain of thought modelling☆10May 12, 2023Updated 3 years ago
- AI Agents - GPT Smart Search Engine - Bot Framework + Azure OpenAI + Azure AI Search + Azure SQL + Bing API + Azure Document Intelligence…☆365Jul 11, 2025Updated last year
- lps-docs☆14Oct 5, 2026Updated last month
- This solution converts speech to text and then processes and summarizes the text based on the prompt scenario.☆38Oct 8, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Azure API Management Developer Portal Import and Export PowerShell scripts☆11Jan 19, 2026Updated 9 months ago
- This sample shows how to create two AKS-hosted chat applications that use OpenAI, LangChain, ChromaDB, and Chainlit using Python and depl…☆44May 7, 2024Updated 2 years ago
- ☆10Jun 1, 2022Updated 4 years ago
- Demonstrates how to build a streaming enterprise agent using Azure AI Agent Service. This sample integrates local HR and company policy d…☆123Mar 3, 2026Updated 8 months ago
- Azure OpenAI benchmarking tool☆153May 28, 2024Updated 2 years ago
- Scaling AOAI using APIM, PTUs and TPMs☆116Updated this week
- Azure OpenAI Starter Kit for .NET Developers☆59Aug 19, 2024Updated 2 years ago