Azure-Samples / azure-openai-apim-load-balancing
This sample demonstrates how to load balance requests between multiple Azure OpenAI Services using Azure API Management.
☆34Updated 10 months ago
Alternatives and similar repositories for azure-openai-apim-load-balancing:
Users that are interested in azure-openai-apim-load-balancing are comparing it to the libraries listed below
- Smart load balancing for OpenAI endpoints and Azure API Management☆51Updated 9 months ago
- A repo to accelerate development and testing of GenAI Gateways built with Azure API Management. Includes various capabilities as examples…☆47Updated last month
- Smart load balancing for Azure OpenAI endpoints☆77Updated 10 months ago
- Azure Open AI Landing Zones Reference Architectures Repository☆99Updated 4 months ago
- Unleash the power of Azure AI to your application developers in a secure & manageable way with Azure API Management and Azure Developer C…☆93Updated this week
- Deploy APIM. Auto-configure it to work with your Azure Open AI.☆93Updated 3 months ago
- Workbook for Azure OpenAI service☆64Updated last month
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆145Updated 2 weeks ago
- Smart load balancing for OpenAI endpoints and Azure API Management☆82Updated 8 months ago
- A demo app showcasing Vector Search using Azure AI Search, Azure OpenAI for text embeddings, and Azure AI Vision for image embeddings.☆72Updated 3 months ago
- Enterprise Azure OpenAI Hub provides prescriptive architecture and guidance to accelerate Generative AI on Azure for all organisations, i…☆78Updated last month
- Open AI with Private Endpoints behind APIM and functionality to get tokens consumption for each consumer☆32Updated 7 months ago
- Generative AI Operations Solution Accelerator☆25Updated 4 months ago
- A web app that lets you play around with various AI-related search approaches☆46Updated 6 months ago
- Smart load balancing for Azure OpenAI endpoints☆45Updated 8 months ago
- This repo contains the reference implementation for the Microsoft Learn Azure OpenAI end to end chat baseline.☆122Updated this week
- ☆35Updated this week
- Scaling AOAI using APIM, PTUs and TPMs☆109Updated 9 months ago
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆20Updated 9 months ago
- This repository contains a collection of Bicep modules designed to deploy a secure Azure AI Foundry environment with robust network and i…☆54Updated 2 months ago
- Indexing Sharepoint Online Content to Azure Cognitive Search☆28Updated 3 months ago
- ☆44Updated last month
- Enterprise Scale AIFactory (esml) - on Azure☆39Updated this week
- ☆25Updated last month
- An AI Control Centre for monitoring, authenticating, and providing resilient access to multiple Open AI services.☆87Updated last week
- ☆13Updated 6 months ago