Smart load balancing for Azure OpenAI endpoints
☆77Apr 19, 2024Updated 2 years ago
Alternatives and similar repositories for aoai-smart-loadbalancing
Users that are interested in aoai-smart-loadbalancing are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Unleash the power of Azure AI to your application developers in a secure & manageable way with Azure API Management and Azure Developer C…☆113May 20, 2026Updated 2 months ago
- Azure OpenAI benchmarking tool☆29Apr 4, 2025Updated last year
- Smart load balancing for OpenAI endpoints and Azure API Management☆51May 24, 2024Updated 2 years ago
- Azure OpenAI benchmarking tool☆153May 28, 2024Updated 2 years ago
- ☆41Nov 29, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Monitors and processes traffic to and from Azure OpenAI endpoints.☆110Jul 16, 2026Updated last week
- Scaling AOAI using APIM, PTUs and TPMs☆114May 17, 2024Updated 2 years ago
- Smart load balancing for Azure OpenAI endpoints☆59Jul 3, 2024Updated 2 years ago
- ☆11Mar 5, 2025Updated last year
- To gain access, please finish setting up this repository now at:☆22Apr 19, 2024Updated 2 years ago
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆23May 12, 2024Updated 2 years ago
- Microsoft Foundry (demos, documentation, accelerators).☆755Updated this week
- ☆45May 12, 2025Updated last year
- ☆39Dec 6, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- AzureAIOBalancer is a Terraform repository for automating the deployment of a load-balanced Azure OpenAI environment across multiple regi…☆10Nov 3, 2023Updated 2 years ago
- A collection of samples demonstrating techniques for processing documents with Azure AI including AI Foundry, OpenAI, Document Intelligen…☆124Oct 27, 2025Updated 8 months ago
- Build, test, and ship omnichannel voice agents on Azure—ACS telephony, custom STT→LLM→TTS pipeline, Voice Live API (voice-to-voice), and …☆74Jul 16, 2026Updated last week
- ☆81Apr 16, 2025Updated last year
- An exploration into creating a simulated API implementation for Azure OpenAI (AOAI)☆13Aug 22, 2024Updated last year
- This repository introduces and helps organizations get started with building Intelligent Apps and incorporating Large Language Models (LL…☆209Sep 4, 2025Updated 10 months ago
- ☆20Updated this week
- This repo contains the reference implementation for the Microsoft Foundry chat baseline reference architecture on Microsoft Learn.☆196Jul 1, 2026Updated 3 weeks ago
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆297Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A repo to accelerate development and testing of GenAI Gateways built with Azure API Management. Includes various capabilities as examples…☆64Jan 29, 2025Updated last year
- ☆27Jul 30, 2025Updated 11 months ago
- Azure IA Services Landing Zone☆117Jun 25, 2024Updated 2 years ago
- AI-in-a-Box leverages the expertise of Microsoft across the globe to develop and provide AI and ML solutions to the technical community. …☆596Dec 12, 2024Updated last year
- Immersive workshop showcasing the remarkable potential of integrating SoTA foundation models to enhance product experiences and streamlin…☆205Dec 9, 2025Updated 7 months ago
- ☆23Oct 10, 2023Updated 2 years ago
- Examples of how-to use Azure OpenAI Log Probabilities (LogProbs) feature to enhance Generative AI - Q&A grounding.☆25May 10, 2025Updated last year
- A sample app for the customer support center running in Azure, using Azure Communication Services and Azure OpenAI for text and voice bot…☆130May 30, 2024Updated 2 years ago
- ☆182Apr 22, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- This repo helps you to build a team of AI agents with Autogen☆237Apr 21, 2026Updated 3 months ago
- Labs to explore AI Models, MCP servers, and Agents with the AI Gateway powered by Azure API Management and Microsoft Foundry 🚀☆960Updated this week
- Hands‑on hackathon challenges to build intelligent multi‑agent financial compliance workflows using the Microsoft Agent Framework☆82Apr 1, 2026Updated 3 months ago
- accelerate the deployment of a Python-based Knowledge Mining solution with OpenAI and use that engine to answer queries / questions speci…☆120Jul 18, 2024Updated 2 years ago
- Using Azure OpenAI GPT 4o to extract information such as text, tables and charts from Documents to Markdown☆28Jan 26, 2025Updated last year
- AI Hub Executive Demo HandsOn☆65Feb 19, 2026Updated 5 months ago
- A demo app showcasing Vector Search using Azure AI Search, Azure OpenAI for text embeddings, and Azure AI Vision for image embeddings.☆76Nov 18, 2024Updated last year