andredewes / apim-aoai-smart-loadbalancingLinks
Smart load balancing for OpenAI endpoints and Azure API Management
☆52Updated last year
Alternatives and similar repositories for apim-aoai-smart-loadbalancing
Users that are interested in apim-aoai-smart-loadbalancing are comparing it to the libraries listed below
Sorting:
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆192Updated last week
- Workbook for Azure OpenAI service☆68Updated 6 months ago
- A repo to accelerate development and testing of GenAI Gateways built with Azure API Management. Includes various capabilities as examples…☆56Updated 6 months ago
- Azure Open AI Landing Zones Reference Architectures Repository☆107Updated 10 months ago
- Smart load balancing for Azure OpenAI endpoints☆77Updated last year
- This repo contains the reference implementation for the Microsoft Learn Azure AI Foundry end to end chat baseline.☆148Updated last week
- This sample demonstrates how to load balance requests between multiple Azure OpenAI Services using Azure API Management.