Smart load balancing for Azure OpenAI endpoints
☆58Jul 3, 2024Updated 2 years ago
Alternatives and similar repositories for openai-aca-lb
Users that are interested in openai-aca-lb are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Smart load balancing for OpenAI endpoints and Azure API Management☆99Jun 18, 2024Updated 2 years ago
- This sample demonstrates how to load balance requests between multiple Azure OpenAI Services using Azure API Management.☆35Apr 4, 2024Updated 2 years ago
- Azure OpenAI benchmarking tool☆153May 28, 2024Updated 2 years ago
- Azure Open AI Landing Zones Reference Architectures Repository☆115Oct 21, 2024Updated last year
- ☆10Jun 1, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Smart load balancing for Azure OpenAI endpoints☆77Apr 19, 2024Updated 2 years ago
- Scaling AOAI using APIM, PTUs and TPMs☆114May 17, 2024Updated 2 years ago
- Monitors and processes traffic to and from Azure OpenAI endpoints.☆110Updated this week
- Multi-modal & multi-domain customer service agent with real time text, voice and soon video☆78Feb 14, 2026Updated 5 months ago
- ☆41Nov 29, 2023Updated 2 years ago
- This is an end-to-end demo showing the power of LLM on top of Azure Data Manager for Energy data☆13Apr 3, 2024Updated 2 years ago
- Build, test, and ship omnichannel voice agents on Azure—ACS telephony, custom STT→LLM→TTS pipeline, Voice Live API (voice-to-voice), and …☆73Updated this week
- AI Hub Executive Demo HandsOn☆65Feb 19, 2026Updated 5 months ago
- Prompts to get exceptional results from AI tools☆60Jun 4, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- The Azure AI Assistant Tool is experimental Python application and middleware designed to simplify the development, experimentation, test…☆139Mar 25, 2025Updated last year
- Tools for evaluation of RAG Chat Apps using Azure AI Evaluate SDK and OpenAI☆333Jul 7, 2026Updated last month
- An AI Control Centre for monitoring, authenticating, and providing resilient access to multiple Open AI services.☆97Sep 9, 2025Updated 11 months ago
- This solution converts speech to text and then processes and summarizes the text based on the prompt scenario.☆20Aug 8, 2024Updated 2 years ago
- A repo to accelerate development and testing of GenAI Gateways built with Azure API Management. Includes various capabilities as examples…☆64Jan 29, 2025Updated last year
- Deploy APIM. Auto-configure it to work with your Azure Open AI.☆115Mar 30, 2026Updated 4 months ago
- This solution accelerator leverages Microsoft Foundry, Azure Content Understanding, Azure OpenAI Service, and Foundry IQ to enable organi…☆463Updated this week
- Contains artefacts accompanying the article - Bots to give life to LOB Apps☆10Jul 7, 2023Updated 3 years ago
- Build 2019 Demos for Knowledge Mining Session☆10May 17, 2019Updated 7 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- AKS with multi-zone ZRS disk demo☆10Apr 21, 2023Updated 3 years ago
- Help engineers to build required infrastructure with Azure OpenAI☆10May 31, 2024Updated 2 years ago
- This repo contains the reference implementation for the Microsoft Foundry chat baseline reference architecture on Microsoft Learn.☆197Aug 3, 2026Updated last week
- AI Agents - GPT Smart Search Engine - Bot Framework + Azure OpenAI + Azure AI Search + Azure SQL + Bing API + Azure Document Intelligence…☆364Jul 11, 2025Updated last year
- Immersive workshop showcasing the remarkable potential of integrating SoTA foundation models to enhance product experiences and streamlin…☆206Dec 9, 2025Updated 8 months ago
- A simple web application for a OpenAI-enabled document search. This repo uses Azure OpenAI Service for creating embeddings vectors from d…☆46Dec 29, 2023Updated 2 years ago
- Examples of how-to use Azure OpenAI Log Probabilities (LogProbs) feature to enhance Generative AI - Q&A grounding.☆25May 10, 2025Updated last year
- Azure container apps terraformed☆10Nov 29, 2022Updated 3 years ago
- ☆45May 12, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆81Apr 16, 2025Updated last year
- A description of the HTTP protocol used by multiple Azure AI chat solutions.☆31Jun 7, 2024Updated 2 years ago
- CLI for managing and generating Foundation Model prompts☆18Apr 14, 2026Updated 3 months ago
- ☆48Nov 6, 2025Updated 9 months ago
- Reference architecture that provides a set of guidelines and best practices for implementing a central AI API gateway to empower various …☆300Updated this week
- Create high-quality visual content with Sora and GPT-Image-1 on Azure OpenAI☆98Mar 20, 2026Updated 4 months ago
- Solution accelerator built on Azure OpenAI Service and Azure AI Document Intelligence to process and extract summaries, entities, and met…☆233Updated this week