microsoft / ai-agent-evalsLinks
Github action to evaluate AI agent applications using model as the judge, content safety and mathematical metrics.
☆62Updated 3 weeks ago
Alternatives and similar repositories for ai-agent-evals
Users that are interested in ai-agent-evals are comparing it to the libraries listed below
Sorting:
- The LLMAgentOps Toolkit is a repository that provides a foundational structure for building LLM Agent-based applications using the Semant…☆16Updated this week
- A recipe that will walk you through using either Meta Llama 3.1 405B or OpenAI GPT-4o deployed on Azure AI to generate a synthetic datase…☆78Updated 6 months ago
- A deployment of a secure, extensible and integrated environment for running AI Foundry workloads in Production. It simplifies the process…☆161Updated this week
- Landing page for Remote MCP Server efforts in Azure Functions with links to all language stack specific repos.☆103Updated 2 months ago
- Solution accelerator built on Azure OpenAI Service and Azure AI Document Intelligence to process and extract summaries, entities, and met…☆199Updated last week
- A simple chat application that integrates Microsoft Entra ID for user authentication. Designed for deployment on Azure Container Apps wit…☆65Updated last week
- This repository is for active development of the Azure AI CLI. For consumers of the CLI, we suggest you check out The Book of AI at https…☆55Updated 10 months ago
- An AI Control Centre for monitoring, authenticating, and providing resilient access to multiple Open AI services.☆95Updated 5 months ago
- A MCP Server for Azure AI Foundry: it's now moved to cloud, check the new Foundry MCP Server☆232Updated 2 months ago
- Guide for designing adaptive, scalable, and secure enterprise multi-agent systems☆161Updated 2 months ago
- ☆29Updated 4 months ago
- Build a copilot application with Azure OpenAI Service, Azure Cosmos DB & Azure App Service.☆110Updated 3 months ago
- Azure API Management as AI Gateway to Remote MCP servers.☆113Updated 4 months ago
- ☆37Updated 8 months ago
- Samples for Azure Container Apps dynamic sessions☆24Updated 3 weeks ago
- ☆119Updated last month
- Reference solution for how to build your own production-ready Copilot in Azure on .NET 8 using: Azure Cosmos DB and its vector database c…☆69Updated last year
- ☆44Updated 8 months ago
- Reddog Cloud Native Solutions☆57Updated last year
- A description of the HTTP protocol used by multiple Azure AI chat solutions.☆31Updated last year
- ☆32Updated last year
- Samples on how to use Azure SQL database with Azure OpenAI☆93Updated 5 months ago
- CosmosAIGraph implementation of OmniRAG pattern☆133Updated last week
- Samples about using vector in SQL Server and Azure SQL☆90Updated 3 weeks ago
- ☆102Updated 8 months ago
- ☆72Updated last week
- ☆32Updated 9 months ago
- This sample shows how to take a ChatGPT prompt as HTTP Get or Post input, calculates the completions using OpenAI ChatGPT service, all ho…☆21Updated 3 months ago
- ☆55Updated last week
- This template deploys a Generative AI Virtual Assistant using Azure OpenAI and Bot Framework.☆77Updated last year