Azure / aoai-smart-loadbalancingLinks
Smart load balancing for Azure OpenAI endpoints
☆77Updated last year
Alternatives and similar repositories for aoai-smart-loadbalancing
Users that are interested in aoai-smart-loadbalancing are comparing it to the libraries listed below
Sorting:
- Unleash the power of Azure AI to your application developers in a secure & manageable way with Azure API Management and Azure Developer C…☆101Updated 3 months ago
- Workbook for Azure OpenAI service☆68Updated 7 months ago
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆196Updated 2 weeks ago
- Azure Open AI Landing Zones Reference Architectures Repository☆107Updated 10 months ago
- This repo contains the reference implementation for the Microsoft Learn Azure AI Foundry end to end chat baseline.☆153Updated last week
- A repo to accelerate development and testing of GenAI Gateways built with Azure API Management. Includes various capabilities as examples…☆56Updated 7 months ago
- Open AI with Private Endpoints behind APIM and functionality to get tokens consumption for each consumer☆37Updated last year
- Smart load balancing for OpenAI endpoints and Azure API Management☆52Updated last year
- This repository introduces and helps organizations get started with building Intelligent Apps and incorporating Large Language Models (LL…☆205Updated last week
- This repository contains a collection of Bicep modules designed to deploy a secure Azure AI Foundry environment with robust network and i…☆60Updated 9 months ago
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆21Updated last year
- ☆84Updated 2 months ago
- ☆62Updated last week
- A web app that lets you play around with various AI-related search approaches☆48Updated last year
- Collection of advanced usage scenarios for Semantic Kernel☆68Updated 4 months ago
- 🧩 Demo: Build AI-powered MCP Tools for GitHub Copilot using Azure Functions, OpenAI, AI Agents & Cosmos DB. Manages code snippets w/ vec…☆65Updated 3 months ago
- A demo app showcasing Vector Search using Azure AI Search, Azure OpenAI for text embeddings, and Azure AI Vision for image embeddings.☆74Updated 9 months ago
- Scaling AOAI using APIM, PTUs and TPMs☆109Updated last year
- This sample demonstrates how to load balance requests between multiple Azure OpenAI Services using Azure API Management.☆34Updated last year
- Implement GenAIOps using Azure AI Foundry with ease and jumpstart☆24Updated 4 months ago
- ☆116Updated last week
- An extension that adds support for Azure OpenAI/ OpenAI bindings in Azure Functions for LLM (GPT-3.5-Turbo, GPT-4, etc)☆98Updated 3 months ago
- ☆36Updated last year
- Demonstrates how to build a streaming enterprise agent using Azure AI Agent Service. This sample integrates local HR and company policy d…☆118Updated 3 months ago
- ☆52Updated 8 months ago
- Smart load balancing for OpenAI endpoints and Azure API Management☆93Updated last year
- One-click deploy Azure Solution Accelerator for Call Center Automation with OpenAI real-time and Azure Communication Service.☆76Updated last month
- Enterprise Azure OpenAI Hub provides prescriptive architecture and guidance to accelerate Generative AI on Azure for all organisations, i…☆85Updated 7 months ago
- Build a copilot application with Azure OpenAI Service, Azure Cosmos DB & Azure App Service.☆102Updated 6 months ago
- An AI Control Centre for monitoring, authenticating, and providing resilient access to multiple Open AI services.☆92Updated this week