Azure / aoai-smart-loadbalancingLinks
Smart load balancing for Azure OpenAI endpoints
☆77Updated last year
Alternatives and similar repositories for aoai-smart-loadbalancing
Users that are interested in aoai-smart-loadbalancing are comparing it to the libraries listed below
Sorting:
- Workbook for Azure OpenAI service☆71Updated last year
- Open AI with Private Endpoints behind APIM and functionality to get tokens consumption for each consumer☆37Updated last year
- Unleash the power of Azure AI to your application developers in a secure & manageable way with Azure API Management and Azure Developer C…☆108Updated 8 months ago
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆21Updated last year
- A web app that lets you play around with various AI-related search approaches☆48Updated 3 months ago
- A demo app showcasing Vector Search using Azure AI Search, Azure OpenAI for text embeddings, and Azure AI Vision for image embeddings.☆75Updated last year
- This repository introduces and helps organizations get started with building Intelligent Apps and incorporating Large Language Models (LL…☆208Updated 5 months ago
- Smart load balancing for OpenAI endpoints and Azure API Management☆52Updated last year
- Azure Open AI Landing Zones Reference Architectures Repository☆113Updated last year
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆243Updated this week
- A repo to accelerate development and testing of GenAI Gateways built with Azure API Management. Includes various capabilities as examples…☆64Updated last year
- This repository contains a collection of Bicep modules designed to deploy a secure Azure AI Foundry environment with robust network and i…☆61Updated last year
- A variation of the Microsoft Foundry chat baseline, altered to be deployed specifically into an application landing zone.☆79Updated 3 weeks ago
- ☆82Updated 9 months ago
- This repo contains the reference implementation for the Microsoft Foundry chat baseline reference architecture on Microsoft Learn.☆184Updated last month
- An extension that adds support for Azure OpenAI/ OpenAI bindings in Azure Functions for LLM (GPT-3.5-Turbo, GPT-4, etc)☆99Updated 2 weeks ago
- An AI Control Centre for monitoring, authenticating, and providing resilient access to multiple Open AI services.☆95Updated 5 months ago
- Deploy APIM. Auto-configure it to work with your Azure Open AI.☆110Updated last year
- This is a list of the Azure AI Solution Accelerators available to demonstrate and simply deployment of Azure AI☆147Updated last year
- ☆52Updated last year
- ☆144Updated last week
- Implement GenAIOps using Azure AI Foundry with ease and jumpstart☆26Updated 9 months ago
- AI-Agents-Lab☆25Updated 11 months ago
- Monitors and processes traffic to and from Azure OpenAI endpoints.☆109Updated this week
- This sample demonstrates how to load balance requests between multiple Azure OpenAI Services using Azure API Management.☆35Updated last year
- ☆96Updated 7 months ago
- Scaling AOAI using APIM, PTUs and TPMs☆113Updated last year
- Smart load balancing for OpenAI endpoints and Azure API Management☆98Updated last year
- 🧩 Build AI-powered MCP Tools with Azure Functions, Durable Agents & Cosmos vector search. Features orchestrated multi-agent workflows us…☆100Updated last month
- ☆37Updated 2 years ago