Smart load balancing for Azure OpenAI endpoints
☆77Apr 19, 2024Updated 2 years ago
Alternatives and similar repositories for aoai-smart-loadbalancing
Users that are interested in aoai-smart-loadbalancing are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Unleash the power of Azure AI to your application developers in a secure & manageable way with Azure API Management and Azure Developer C…☆113May 20, 2026Updated 5 months ago
- Monitors and processes traffic to and from Azure OpenAI endpoints.☆110Updated this week
- Smart load balancing for OpenAI endpoints and Azure API Management☆51May 24, 2024Updated 2 years ago
- ☆11Mar 5, 2025Updated last year
- Azure OpenAI benchmarking tool☆153May 28, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Azure OpenAI benchmarking tool☆29Apr 4, 2025Updated last year
- Scaling AOAI using APIM, PTUs and TPMs☆116May 17, 2024Updated 2 years ago
- ☆41Nov 29, 2023Updated 2 years ago
- AOAI Realtime sample with multiple assistants☆14Nov 29, 2024Updated last year
- Smart load balancing for Azure OpenAI endpoints☆58Jul 3, 2024Updated 2 years ago
- A repo to accelerate development and testing of GenAI Gateways built with Azure API Management. Includes various capabilities as examples…☆64Aug 23, 2026Updated 2 months ago
- Microsoft Foundry (demos, documentation, accelerators).☆755Updated this week
- Build multimodal data processing pipelines with Azure AI Services + LLMs☆144Apr 15, 2025Updated last year
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆24May 12, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- To gain access, please finish setting up this repository now at:☆22Apr 19, 2024Updated 2 years ago
- ☆80Apr 16, 2025Updated last year
- Query data from data lake in natural language: LLMs + Chain of thought modelling☆10May 12, 2023Updated 3 years ago
- This repository introduces and helps organizations get started with building Intelligent Apps and incorporating Large Language Models (LL…☆211Updated this week
- Using Azure OpenAI GPT 4o to extract information such as text, tables and charts from Documents to Markdown☆28Jan 26, 2025Updated last year
- AzureAIOBalancer is a Terraform repository for automating the deployment of a load-balanced Azure OpenAI environment across multiple regi…☆10Nov 3, 2023Updated 2 years ago
- ☆39Dec 6, 2023Updated 2 years ago
- Build, test, and ship omnichannel voice agents on Azure—ACS telephony, custom STT→LLM→TTS pipeline, Voice Live API (voice-to-voice), and …☆74Oct 26, 2026Updated last week
- ☆45May 12, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A collection of samples demonstrating techniques for processing documents with Azure AI including AI Foundry, OpenAI, Document Intelligen…☆127Oct 27, 2025Updated last year
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆322Updated this week
- This sample demonstrates how to load balance requests between multiple Azure OpenAI Services using Azure API Management.☆35Apr 4, 2024Updated 2 years ago
- ☆20Oct 24, 2026Updated last week
- An exploration into creating a simulated API implementation for Azure OpenAI (AOAI)☆13Aug 22, 2024Updated 2 years ago
- ☆66Oct 8, 2024Updated 2 years ago
- This repo contains the reference implementation for the Microsoft Foundry chat baseline reference architecture on Microsoft Learn.☆206Sep 3, 2026Updated last month
- Examples of how-to use Azure OpenAI Log Probabilities (LogProbs) feature to enhance Generative AI - Q&A grounding.☆25May 10, 2025Updated last year
- ☆182Apr 22, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆54Apr 8, 2026Updated 6 months ago
- ☆74Sep 25, 2023Updated 3 years ago
- Alternative graph implementations built on the Azure CosmosDB SQL API, Java, Spring Boot, and Spring Data☆11Sep 23, 2024Updated 2 years ago
- AI-in-a-Box leverages the expertise of Microsoft across the globe to develop and provide AI and ML solutions to the technical community. …☆598Dec 12, 2024Updated last year
- Learn how to build solutions with Large Language Models.☆167Aug 20, 2026Updated 2 months ago
- Azure Open AI Landing Zones Reference Architectures Repository☆118Oct 21, 2024Updated 2 years ago
- accelerate the deployment of a Python-based Knowledge Mining solution with OpenAI and use that engine to answer queries / questions speci…☆120Jul 18, 2024Updated 2 years ago