Github action to evaluate AI agent applications using model as the judge, content safety and mathematical metrics.
☆104May 20, 2026Updated 4 months ago
Alternatives and similar repositories for ai-agent-evals
Users that are interested in ai-agent-evals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GitAGU (Git Agent Unblock) - A centralized platform for discovering, configuring, and integrating AI agents into your development workflo…☆31Sep 14, 2026Updated last month
- An agentic evaluation framework☆23Feb 11, 2026Updated 8 months ago
- ☆29Oct 9, 2026Updated last week
- The LLMAgentOps Toolkit is a repository that provides a foundational structure for building LLM Agent-based applications using the Semant…☆19Apr 1, 2026Updated 6 months ago
- Implement GenAIOps using Azure AI Foundry with ease and jumpstart☆27Jul 10, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 🤖 How GitHub Copilot has grown and changed 💡 Exciting new features and updates 📺 A live Copilot demo in action☆19Oct 10, 2026Updated last week
- AI demos at the Expert Meetup booths showcasing models, agents, and tools.☆53May 29, 2025Updated last year
- SK Multi agentic advanced orchestration example☆17Feb 20, 2026Updated 7 months ago
- A plugin for AI agent evaluation. Plan evals, generate test cases, interpret results for Copilot Studio agents. Grounded in Microsoft's E…☆138Jun 24, 2026Updated 3 months ago
- A repository that uses LLMs to evaluate other LLMs in a structured way☆40Feb 11, 2026Updated 8 months ago
- ☆24Nov 6, 2025Updated 11 months ago
- This repository hosts the instructions and workshop materials for Lab 331 (Deep Research with Langchain and DeepSeek R1) for Microsoft Bu…☆26Jun 5, 2025Updated last year
- MCP server for Fabric Real-Time Intelligence (https://aka.ms/fabricrti) supporting tools for Eventhouse (https://aka.ms/eventhouse), Azur…☆132Updated this week
- gpt-rag-mcp☆22Oct 8, 2026Updated last week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Tutorial Materials for the paper "Evaluation & Benchmarking of LLM Agents: A Survey" published in KDD 2025 Conference.☆21Jun 12, 2026Updated 4 months ago
- Solution Accelerator to show how to deploy an Agent configured in Copilot Studio to streamline NDA document creation, management and sign…☆47Nov 1, 2025Updated 11 months ago
- ☆33May 15, 2026Updated 5 months ago
- ☆149Feb 11, 2026Updated 8 months ago
- Foundry MCP playground (experimental)☆61Jul 21, 2025Updated last year
- Guide for designing adaptive, scalable, and secure enterprise multi-agent systems☆241Aug 10, 2026Updated 2 months ago
- AGENT-FORGE is a Context Engineering Toolkit that generates GitHub Copilot customization files for your VS Code project. Instead of manua…☆88Apr 16, 2026Updated 6 months ago
- A library used for generating C# classes from DTDL interfaces.☆15Jul 9, 2024Updated 2 years ago
- ReMe: A Personalized Cognitive Training Framework Based on an LLM Voice Chatbot for Research☆18Jul 3, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Declarative Agent Schema☆26Jul 10, 2026Updated 3 months ago
- Composable AI Reference Architectures (CAIRA)☆229Sep 22, 2026Updated 3 weeks ago
- Microsoft AI Value Accelerator☆33Jul 30, 2024Updated 2 years ago
- The Multi-Agent Custom Automation Engine Solution Accelerator is an AI-driven system that manages a group of AI agents to accomplish task…☆888Updated this week
- An 18 notebook course that isolates and measures each component of agentic loop engineering on real, industry standard software datasets.☆59Jun 29, 2026Updated 3 months ago
- This solution streamlines HR service workflows with an AI-powered assistant that delivers instant answers, automates record updates, and …☆28Nov 1, 2025Updated 11 months ago
- A sample app for the Multimodal Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure Op…☆68Jan 23, 2026Updated 8 months ago
- Free Chat and Agent usage analytics from log files☆21Jul 2, 2026Updated 3 months ago
- This repo contains hands-on labs for building AI Agents using the Azure AI Agent Service SDK and Semantic Kernel. The Azure AI Agent Serv…☆87Feb 20, 2026Updated 7 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Collection of advanced usage scenarios for Semantic Kernel☆74Apr 21, 2026Updated 5 months ago
- This project implements an agentic app using Magentic Orchestration from Semantic Kernel deployed on Azure Kubernetes Service. The system…☆16Jun 10, 2025Updated last year
- A MCP Server for Azure AI Foundry: it's now moved to cloud, check the new Foundry MCP Server☆260Jul 10, 2026Updated 3 months ago
- Samples for Microsoft Foundry platform☆465Updated this week
- ☆31Aug 24, 2026Updated last month
- A comprehensive set of samples of creating and using MCP servers and clients with .NET☆200Updated this week
- Develop pro-code personal agents integrated with memory service on Teams☆28Updated this week