Azure / aoai-smart-loadbalancingLinks
Smart load balancing for Azure OpenAI endpoints
☆77Updated last year
Alternatives and similar repositories for aoai-smart-loadbalancing
Users that are interested in aoai-smart-loadbalancing are comparing it to the libraries listed below
Sorting:
- Workbook for Azure OpenAI service☆70Updated 10 months ago
- Unleash the power of Azure AI to your application developers in a secure & manageable way with Azure API Management and Azure Developer C…☆103Updated 7 months ago
- Open AI with Private Endpoints behind APIM and functionality to get tokens consumption for each consumer☆37Updated last year
- Azure Open AI Landing Zones Reference Architectures Repository☆111Updated last year
- This repository introduces and helps organizations get started with building Intelligent Apps and incorporating Large Language Models (LL…☆207Updated 3 months ago
- A repo to accelerate development and testing of GenAI Gateways built with Azure API Management. Includes various capabilities as examples…☆61Updated 10 months ago
- A web app that lets you play around with various AI-related search approaches☆48Updated 2 months ago
- ☆95Updated 5 months ago
- Smart load balancing for OpenAI endpoints and Azure API Management☆52Updated last year
- A demo app showcasing Vector Search using Azure AI Search, Azure OpenAI for text embeddings, and Azure AI Vision for image embeddings.☆75Updated last year
- ☆82Updated 8 months ago
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆230Updated this week
- This repo contains the reference implementation for the Microsoft Foundry chat baseline reference architecture on Microsoft Learn.☆177Updated 3 weeks ago
- An extension that adds support for Azure OpenAI/ OpenAI bindings in Azure Functions for LLM (GPT-3.5-Turbo, GPT-4, etc)☆98Updated 2 weeks ago
- 🧩 Build AI-powered MCP Tools with Azure Functions, Durable Agents & Cosmos vector search. Features orchestrated multi-agent workflows us…☆89Updated this week
- ☆52Updated 11 months ago
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆21Updated last year
- This repository contains a collection of Bicep modules designed to deploy a secure Azure AI Foundry environment with robust network and i…☆60Updated last year
- Enterprise Azure OpenAI Hub provides prescriptive architecture and guidance to accelerate Generative AI on Azure for all organisations, i…☆84Updated 11 months ago
- Collection of advanced usage scenarios for Semantic Kernel☆74Updated 7 months ago
- Demonstrates how to build a streaming enterprise agent using Azure AI Agent Service. This sample integrates local HR and company policy d…☆121Updated 6 months ago
- Build a copilot application with Azure OpenAI Service, Azure Cosmos DB & Azure App Service.☆108Updated 2 months ago
- ☆137Updated this week
- This is a list of the Azure AI Solution Accelerators available to demonstrate and simply deployment of Azure AI☆145Updated last year
- An AI Control Centre for monitoring, authenticating, and providing resilient access to multiple Open AI services.☆93Updated 3 months ago
- Scaling AOAI using APIM, PTUs and TPMs☆110Updated last year
- Implement GenAIOps using Azure AI Foundry with ease and jumpstart☆26Updated 8 months ago
- ☆37Updated 2 years ago
- This sample demonstrates how to load balance requests between multiple Azure OpenAI Services using Azure API Management.☆35Updated last year
- AI Hub Executive Demo HandsOn☆64Updated 3 weeks ago