Smart load balancing for Azure OpenAI endpoints
☆77Apr 19, 2024Updated 2 years ago
Alternatives and similar repositories for aoai-smart-loadbalancing
Users that are interested in aoai-smart-loadbalancing are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Unleash the power of Azure AI to your application developers in a secure & manageable way with Azure API Management and Azure Developer C…☆113May 20, 2026Updated 3 months ago
- Azure OpenAI benchmarking tool☆29Apr 4, 2025Updated last year
- Smart load balancing for OpenAI endpoints and Azure API Management☆51May 24, 2024Updated 2 years ago
- Azure OpenAI benchmarking tool☆153May 28, 2024Updated 2 years ago
- ☆41Nov 29, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Monitors and processes traffic to and from Azure OpenAI endpoints.☆110Aug 25, 2026Updated last week
- Scaling AOAI using APIM, PTUs and TPMs☆115May 17, 2024Updated 2 years ago
- Smart load balancing for Azure OpenAI endpoints☆58Jul 3, 2024Updated 2 years ago
- ☆11Mar 5, 2025Updated last year
- To gain access, please finish setting up this repository now at:☆22Apr 19, 2024Updated 2 years ago
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆24May 12, 2024Updated 2 years ago
- Microsoft Foundry (demos, documentation, accelerators).☆754Jul 22, 2026Updated last month
- ☆45May 12, 2025Updated last year
- ☆39Dec 6, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- AzureAIOBalancer is a Terraform repository for automating the deployment of a load-balanced Azure OpenAI environment across multiple regi…☆10Nov 3, 2023Updated 2 years ago
- A collection of samples demonstrating techniques for processing documents with Azure AI including AI Foundry, OpenAI, Document Intelligen…☆124Oct 27, 2025Updated 10 months ago
- Build, test, and ship omnichannel voice agents on Azure—ACS telephony, custom STT→LLM→TTS pipeline, Voice Live API (voice-to-voice), and …☆73Aug 9, 2026Updated 3 weeks ago
- ☆81Apr 16, 2025Updated last year
- An exploration into creating a simulated API implementation for Azure OpenAI (AOAI)☆13Aug 22, 2024Updated 2 years ago
- This repository introduces and helps organizations get started with building Intelligent Apps and incorporating Large Language Models (LL…☆210Sep 4, 2025Updated 11 months ago
- ☆20Aug 9, 2026Updated 3 weeks ago
- This repo contains the reference implementation for the Microsoft Foundry chat baseline reference architecture on Microsoft Learn.☆200Aug 3, 2026Updated 3 weeks ago
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆307Aug 26, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A repo to accelerate development and testing of GenAI Gateways built with Azure API Management. Includes various capabilities as examples…☆64Aug 23, 2026Updated last week
- ☆28Jul 30, 2025Updated last year
- Azure IA Services Landing Zone☆118Jun 25, 2024Updated 2 years ago
- AI-in-a-Box leverages the expertise of Microsoft across the globe to develop and provide AI and ML solutions to the technical community. …☆596Dec 12, 2024Updated last year
- Immersive workshop showcasing the remarkable potential of integrating SoTA foundation models to enhance product experiences and streamlin…☆206Dec 9, 2025Updated 8 months ago
- ☆23Oct 10, 2023Updated 2 years ago
- Examples of how-to use Azure OpenAI Log Probabilities (LogProbs) feature to enhance Generative AI - Q&A grounding.☆25May 10, 2025Updated last year
- A sample app for the customer support center running in Azure, using Azure Communication Services and Azure OpenAI for text and voice bot…☆131May 30, 2024Updated 2 years ago
- ☆182Apr 22, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- This repo helps you to build a team of AI agents with Autogen☆237Apr 21, 2026Updated 4 months ago
- App leveraging multimodal Azure AI showing an innovative real-time customer experience.☆35Feb 3, 2025Updated last year
- Labs to explore AI Models, MCP servers, and Agents with the AI Gateway powered by Azure API Management and Microsoft Foundry 🚀☆982Aug 7, 2026Updated 3 weeks ago
- Hands‑on hackathon challenges to build intelligent multi‑agent financial compliance workflows using the Microsoft Agent Framework☆84Apr 1, 2026Updated 5 months ago
- accelerate the deployment of a Python-based Knowledge Mining solution with OpenAI and use that engine to answer queries / questions speci…☆120Jul 18, 2024Updated 2 years ago
- Using Azure OpenAI GPT 4o to extract information such as text, tables and charts from Documents to Markdown☆28Jan 26, 2025Updated last year
- AI Hub Executive Demo HandsOn☆65Updated this week