Smart load balancing for Azure OpenAI endpoints
☆77Apr 19, 2024Updated last year
Alternatives and similar repositories for aoai-smart-loadbalancing
Users that are interested in aoai-smart-loadbalancing are comparing it to the libraries listed below
Sorting:
- ☆41Nov 29, 2023Updated 2 years ago
- Azure OpenAI benchmarking tool☆28Apr 4, 2025Updated 11 months ago
- Azure OpenAI benchmarking tool☆151May 28, 2024Updated last year
- Unleash the power of Azure AI to your application developers in a secure & manageable way with Azure API Management and Azure Developer C…☆108May 16, 2025Updated 9 months ago
- Monitors and processes traffic to and from Azure OpenAI endpoints.☆110Updated this week
- Smart load balancing for OpenAI endpoints and Azure API Management☆52May 24, 2024Updated last year
- Scaling AOAI using APIM, PTUs and TPMs☆113May 17, 2024Updated last year
- Azure AI Foundry (demos, documentation, accelerators).☆748Updated this week
- ☆24May 1, 2025Updated 10 months ago
- ☆44May 12, 2025Updated 9 months ago
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆253Feb 20, 2026Updated last week
- App leveraging multimodal Azure AI showing an innovative real-time customer experience.☆34Feb 3, 2025Updated last year
- ☆11Mar 5, 2025Updated 11 months ago
- AzureAIOBalancer is a Terraform repository for automating the deployment of a load-balanced Azure OpenAI environment across multiple regi…☆10Nov 3, 2023Updated 2 years ago
- A variation of the Microsoft Foundry chat baseline, altered to be deployed specifically into an application landing zone.☆80Jan 16, 2026Updated last month
- Azure IA Services Landing Zone☆114Jun 25, 2024Updated last year
- To gain access, please finish setting up this repository now at:☆22Apr 19, 2024Updated last year
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆21May 12, 2024Updated last year
- Immersive workshop showcasing the remarkable potential of integrating SoTA foundation models to enhance product experiences and streamlin…☆204Dec 9, 2025Updated 2 months ago
- A demo app showcasing Vector Search using Azure AI Search, Azure OpenAI for text embeddings, and Azure AI Vision for image embeddings.☆75Nov 18, 2024Updated last year
- ☆39Dec 6, 2023Updated 2 years ago
- This repository introduces and helps organizations get started with building Intelligent Apps and incorporating Large Language Models (LL…☆207Sep 4, 2025Updated 6 months ago
- ☆27Jul 30, 2025Updated 7 months ago
- ☆23Oct 10, 2023Updated 2 years ago
- An exploration into creating a simulated API implementation for Azure OpenAI (AOAI)☆13Aug 22, 2024Updated last year
- This repo contains the reference implementation for the Microsoft Foundry chat baseline reference architecture on Microsoft Learn.☆188Updated this week
- Smart load balancing for Azure OpenAI endpoints☆57Jul 3, 2024Updated last year
- ☆82Apr 16, 2025Updated 10 months ago
- A repo to accelerate development and testing of GenAI Gateways built with Azure API Management. Includes various capabilities as examples…☆64Jan 29, 2025Updated last year
- AI-in-a-Box leverages the expertise of Microsoft across the globe to develop and provide AI and ML solutions to the technical community. …☆592Dec 12, 2024Updated last year
- ☆64Oct 8, 2024Updated last year
- Build multimodal data processing pipelines with Azure AI Services + LLMs☆143Apr 15, 2025Updated 10 months ago
- Labs to explore AI Models, MCP servers, and Agents with the AI Gateway powered by Azure API Management and Microsoft Foundry 🚀☆876Updated this week
- accelerate the deployment of a Python-based Knowledge Mining solution with OpenAI and use that engine to answer queries / questions speci…☆120Jul 18, 2024Updated last year
- AI Hub Executive Demo HandsOn☆64Feb 19, 2026Updated last week
- A description of the HTTP protocol used by multiple Azure AI chat solutions.☆31Jun 7, 2024Updated last year
- This repo helps you to build a team of AI agents with Autogen☆231Updated this week
- This solution accelerator leverages Microsoft Foundry, Azure Content Understanding, Azure OpenAI Service, and Foundry IQ to enable organi…☆423Updated this week
- Workbook for Azure OpenAI service☆72Jan 28, 2025Updated last year