Smart load balancing for Azure OpenAI endpoints
☆77Apr 19, 2024Updated 2 years ago
Alternatives and similar repositories for aoai-smart-loadbalancing
Users that are interested in aoai-smart-loadbalancing are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Azure OpenAI benchmarking tool☆29Apr 4, 2025Updated last year
- Unleash the power of Azure AI to your application developers in a secure & manageable way with Azure API Management and Azure Developer C…☆111May 16, 2025Updated last year
- Smart load balancing for OpenAI endpoints and Azure API Management☆51May 24, 2024Updated 2 years ago
- Azure OpenAI benchmarking tool☆152May 28, 2024Updated last year
- ☆41Nov 29, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Monitors and processes traffic to and from Azure OpenAI endpoints.☆109May 18, 2026Updated last week
- Scaling AOAI using APIM, PTUs and TPMs☆114May 17, 2024Updated 2 years ago
- ☆11Mar 5, 2025Updated last year
- To gain access, please finish setting up this repository now at:☆22Apr 19, 2024Updated 2 years ago
- Smart load balancing for Azure OpenAI endpoints☆60Jul 3, 2024Updated last year
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆22May 12, 2024Updated 2 years ago
- Microsoft Foundry (demos, documentation, accelerators).☆752Apr 28, 2026Updated 3 weeks ago
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆279May 12, 2026Updated last week
- ☆44May 12, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆39Dec 6, 2023Updated 2 years ago
- This repository introduces and helps organizations get started with building Intelligent Apps and incorporating Large Language Models (LL…☆206Sep 4, 2025Updated 8 months ago
- AzureAIOBalancer is a Terraform repository for automating the deployment of a load-balanced Azure OpenAI environment across multiple regi…☆10Nov 3, 2023Updated 2 years ago
- ☆81Apr 16, 2025Updated last year
- An exploration into creating a simulated API implementation for Azure OpenAI (AOAI)☆13Aug 22, 2024Updated last year
- ☆28May 1, 2025Updated last year
- A repo to accelerate development and testing of GenAI Gateways built with Azure API Management. Includes various capabilities as examples…☆64Jan 29, 2025Updated last year
- A variation of the Microsoft Foundry chat baseline, altered to be deployed specifically into an application landing zone.☆87May 13, 2026Updated last week
- App leveraging multimodal Azure AI showing an innovative real-time customer experience.☆35Feb 3, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Azure IA Services Landing Zone☆117Jun 25, 2024Updated last year
- AI-in-a-Box leverages the expertise of Microsoft across the globe to develop and provide AI and ML solutions to the technical community. …☆599Dec 12, 2024Updated last year
- ☆23Oct 10, 2023Updated 2 years ago
- Immersive workshop showcasing the remarkable potential of integrating SoTA foundation models to enhance product experiences and streamlin…☆204Dec 9, 2025Updated 5 months ago
- Indexing Sharepoint Online Content to Azure Cognitive Search☆37Nov 15, 2024Updated last year
- Labs to explore AI Models, MCP servers, and Agents with the AI Gateway powered by Azure API Management and Microsoft Foundry 🚀☆925Updated this week
- A sample app for the customer support center running in Azure, using Azure Communication Services and Azure OpenAI for text and voice bot…☆129May 30, 2024Updated last year
- ☆27Jul 30, 2025Updated 9 months ago
- This repo helps you to build a team of AI agents with Autogen☆235Apr 21, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- This repo contains the reference implementation for the Microsoft Foundry chat baseline reference architecture on Microsoft Learn.☆194May 15, 2026Updated last week
- ☆181Apr 22, 2024Updated 2 years ago
- accelerate the deployment of a Python-based Knowledge Mining solution with OpenAI and use that engine to answer queries / questions speci…☆120Jul 18, 2024Updated last year
- This solution accelerator leverages Microsoft Foundry, Azure Content Understanding, Azure OpenAI Service, and Foundry IQ to enable organi…☆446Updated this week
- New repo for new Developer Productivity lab☆31Oct 31, 2024Updated last year
- A demo app showcasing Vector Search using Azure AI Search, Azure OpenAI for text embeddings, and Azure AI Vision for image embeddings.☆76Nov 18, 2024Updated last year
- Using Azure OpenAI GPT 4o to extract information such as text, tables and charts from Documents to Markdown☆28Jan 26, 2025Updated last year