Github action to evaluate AI agent applications using model as the judge, content safety and mathematical metrics.
☆99May 20, 2026Updated 3 months ago
Alternatives and similar repositories for ai-agent-evals
Users that are interested in ai-agent-evals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GitAGU (Git Agent Unblock) - A centralized platform for discovering, configuring, and integrating AI agents into your development workflo…☆31Apr 13, 2026Updated 4 months ago
- An agentic evaluation framework☆23Feb 11, 2026Updated 6 months ago
- ☆28Apr 21, 2026Updated 4 months ago
- The LLMAgentOps Toolkit is a repository that provides a foundational structure for building LLM Agent-based applications using the Semant…☆19Apr 1, 2026Updated 5 months ago
- Implement GenAIOps using Azure AI Foundry with ease and jumpstart☆27Jul 10, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 🤖 How GitHub Copilot has grown and changed 💡 Exciting new features and updates 📺 A live Copilot demo in action☆19Jul 5, 2026Updated 2 months ago
- AI demos at the Expert Meetup booths showcasing models, agents, and tools.☆53May 29, 2025Updated last year
- A repository that uses LLMs to evaluate other LLMs in a structured way☆35Feb 11, 2026Updated 6 months ago
- SK Multi agentic advanced orchestration example☆17Feb 20, 2026Updated 6 months ago
- ☆24Nov 6, 2025Updated 10 months ago
- This repository hosts the instructions and workshop materials for Lab 331 (Deep Research with Langchain and DeepSeek R1) for Microsoft Bu…☆26Jun 5, 2025Updated last year
- MCP server for Fabric Real-Time Intelligence (https://aka.ms/fabricrti) supporting tools for Eventhouse (https://aka.ms/eventhouse), Azur…☆130Updated this week
- Solution Accelerator to show how to deploy an Agent configured in Copilot Studio to streamline NDA document creation, management and sign…☆47Nov 1, 2025Updated 10 months ago
- Tutorial Materials for the paper "Evaluation & Benchmarking of LLM Agents: A Survey" published in KDD 2025 Conference.☆21Jun 12, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- gpt-rag-mcp☆22Updated this week
- AGENT-FORGE is a Context Engineering Toolkit that generates GitHub Copilot customization files for your VS Code project. Instead of manua…☆83Apr 16, 2026Updated 4 months ago
- ☆33May 15, 2026Updated 3 months ago
- ☆149Feb 11, 2026Updated 6 months ago
- Guide for designing adaptive, scalable, and secure enterprise multi-agent systems☆234Aug 10, 2026Updated 3 weeks ago
- Declarative Agent Schema☆25Jul 10, 2026Updated last month
- Sample Solution with .NET Blazor to implement OpenAI ChatGPT☆11Mar 5, 2023Updated 3 years ago
- Foundry MCP playground (experimental)☆62Jul 21, 2025Updated last year
- A library used for generating C# classes from DTDL interfaces.☆15Jul 9, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ReMe: A Personalized Cognitive Training Framework Based on an LLM Voice Chatbot for Research☆18Jul 3, 2025Updated last year
- Composable AI Reference Architectures (CAIRA)☆227Updated this week
- Microsoft AI Value Accelerator☆33Jul 30, 2024Updated 2 years ago
- A versatile tool designed to help prototype intelligent assistants, agents and multi-agentic systems☆406Apr 1, 2026Updated 5 months ago
- This solution streamlines HR service workflows with an AI-powered assistant that delivers instant answers, automates record updates, and …☆28Nov 1, 2025Updated 10 months ago
- A sample app for the Multimodal Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure Op…☆66Jan 23, 2026Updated 7 months ago
- The Multi-Agent Custom Automation Engine Solution Accelerator is an AI-driven system that manages a group of AI agents to accomplish task…☆878Updated this week
- Free Chat and Agent usage analytics from log files☆19Jul 2, 2026Updated 2 months ago
- A MCP Server for Azure AI Foundry: it's now moved to cloud, check the new Foundry MCP Server☆260Jul 10, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Reference implementation of CLI interface for Amplifier project☆19Updated this week
- Collection of advanced usage scenarios for Semantic Kernel☆73Apr 21, 2026Updated 4 months ago
- This repo contains hands-on labs for building AI Agents using the Azure AI Agent Service SDK and Semantic Kernel. The Azure AI Agent Serv…☆84Feb 20, 2026Updated 6 months ago
- Develop pro-code personal agents integrated with memory service on Teams☆28Aug 31, 2026Updated last week
- Embedded samples in Azure AI Foundry docs☆438Updated this week
- A comprehensive set of samples of creating and using MCP servers and clients with .NET☆196Updated this week
- This project implements an agentic app using Magentic Orchestration from Semantic Kernel deployed on Azure Kubernetes Service. The system…☆16Jun 10, 2025Updated last year