Github action to evaluate AI agent applications using model as the judge, content safety and mathematical metrics.
☆65Jan 16, 2026Updated last month
Alternatives and similar repositories for ai-agent-evals
Users that are interested in ai-agent-evals are comparing it to the libraries listed below
Sorting:
- The LLMAgentOps Toolkit is a repository that provides a foundational structure for building LLM Agent-based applications using the Semant…☆16Feb 20, 2026Updated last week
- Playground for building AI Agents on Azure☆30Mar 31, 2025Updated 11 months ago
- eShopLite - Semantic Search is a reference .NET application implementing an eCommerce site with Search features using Keyword Search and …☆13Apr 24, 2025Updated 10 months ago
- ReMe: A Personalized Cognitive Training Framework Based on an LLM Voice Chatbot for Research☆17Jul 3, 2025Updated 8 months ago
- SK Multi agentic advanced orchestration example☆15Feb 20, 2026Updated last week
- GitAGU (Git Agent Unblock) - A centralized platform for discovering, configuring, and integrating AI agents into your development workflo…☆23Jul 9, 2025Updated 7 months ago
- ☆12Aug 6, 2020Updated 5 years ago
- This lab is a starter for quickly and easily applying SLM/LLM fine-tuning, evaluation, and quantization with torchtune on Azure ML.☆15Sep 23, 2025Updated 5 months ago
- ☆36Nov 15, 2024Updated last year
- A sample OpenAI plugin using ASP.NET Core API☆18Jun 22, 2023Updated 2 years ago
- Blazor Pizza App and Azure for .NET Conf☆14Nov 17, 2022Updated 3 years ago
- ☆39Jan 16, 2026Updated last month
- ☆29Nov 27, 2025Updated 3 months ago
- Examples of how-to use Azure OpenAI Log Probabilities (LogProbs) feature to enhance Generative AI - Q&A grounding.☆25May 10, 2025Updated 9 months ago
- ☆31Sep 17, 2025Updated 5 months ago
- End-to-end solution sample for a travel assistant built with the Azure Agent Runtime☆29Jan 13, 2026Updated last month
- An AI Control Centre for monitoring, authenticating, and providing resilient access to multiple Open AI services.☆96Sep 9, 2025Updated 5 months ago
- Azure AI Agents Playbook☆33Jan 27, 2026Updated last month
- Magentic-Marketplace: Simulate Agentic Markets and See How They Evolve☆133Updated this week
- ☆32Apr 11, 2025Updated 10 months ago
- Hub-spoke network topology in Azure☆21Jul 8, 2020Updated 5 years ago
- Activate GenAI with Azure☆23Jan 26, 2026Updated last month
- Repository for the digital twin of the Analog-Optical Computer, a novel in-memory analog AI accelerator targeting inference of fixed-poin…☆41Dec 14, 2025Updated 2 months ago
- Microsoft AI Value Accelerator☆33Jul 30, 2024Updated last year
- A collection of templates integrating Microsoft Teams with various AI agent paradigms.☆77Feb 14, 2026Updated 2 weeks ago
- ☆59Dec 4, 2025Updated 3 months ago
- Observability with Microsoft Azure in a breeze.☆23Feb 23, 2026Updated last week
- A simple C#/.NET chat application using .NET Aspire and Microsoft.Extensions.AI. This uses managed identity for Azure OpenAI access. Desi…☆33Feb 12, 2026Updated 2 weeks ago
- LINEBot☆13Apr 7, 2025Updated 10 months ago
- Scaling AOAI using APIM, PTUs and TPMs☆113May 17, 2024Updated last year
- The AKS CAF Solution Factory has contents to help deployment of Kubernetes to Azure in alignment to Cloud Adoption Framework.☆28Aug 5, 2020Updated 5 years ago
- A 1-2 day hackathon to help users learn the concepts and technical skills to build AI-enabled applications and services in Azure.☆71Apr 22, 2024Updated last year
- A LangGraph-based research assistant that helps find, analyze, and summarize scientific papers. Built with Mistral LLM (via Ollama) and F…☆27Mar 4, 2025Updated last year
- ☆32Aug 20, 2024Updated last year
- Sample Code for eBook - Use Power Apps to bring your business and pro devs together to build apps fast☆36Mar 3, 2023Updated 3 years ago
- A lightweight web client for Interactive Geospatial Feature Discovery.☆48Feb 5, 2026Updated 3 weeks ago
- The Azure AI proxy service facilitates easy access to Azure AI resources for workshops and hackathons. It offers a Playground-like interf…☆82Oct 17, 2024Updated last year
- Demo code for the Custom Copilot Demo☆11Dec 3, 2024Updated last year
- Contains curated community Microsoft Power App samples☆10Feb 2, 2023Updated 3 years ago