Github action to evaluate AI agent applications using model as the judge, content safety and mathematical metrics.
☆94May 20, 2026Updated 2 months ago
Alternatives and similar repositories for ai-agent-evals
Users that are interested in ai-agent-evals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GitAGU (Git Agent Unblock) - A centralized platform for discovering, configuring, and integrating AI agents into your development workflo…☆30Apr 13, 2026Updated 3 months ago
- An agentic evaluation framework☆20Feb 11, 2026Updated 5 months ago
- ☆28Apr 21, 2026Updated 3 months ago
- The LLMAgentOps Toolkit is a repository that provides a foundational structure for building LLM Agent-based applications using the Semant…☆18Apr 1, 2026Updated 3 months ago
- Enables solution engineers to customize, deploy, and collaborate on multi-agent AI solutions using Azure AI Foundry☆18Feb 11, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Implement GenAIOps using Azure AI Foundry with ease and jumpstart☆27Jul 10, 2026Updated 2 weeks ago
- A repository that uses LLMs to evaluate other LLMs in a structured way☆30Feb 11, 2026Updated 5 months ago
- 🤖 How GitHub Copilot has grown and changed 💡 Exciting new features and updates 📺 A live Copilot demo in action☆19Jul 5, 2026Updated 2 weeks ago
- AI demos at the Expert Meetup booths showcasing models, agents, and tools.☆53May 29, 2025Updated last year
- SK Multi agentic advanced orchestration example☆16Feb 20, 2026Updated 5 months ago
- ☆24Nov 6, 2025Updated 8 months ago
- This repository hosts the instructions and workshop materials for Lab 331 (Deep Research with Langchain and DeepSeek R1) for Microsoft Bu…☆26Jun 5, 2025Updated last year
- MCP server for Fabric Real-Time Intelligence (https://aka.ms/fabricrti) supporting tools for Eventhouse (https://aka.ms/eventhouse), Azur…☆126Updated this week
- Solution Accelerator to show how to deploy an Agent configured in Copilot Studio to streamline NDA document creation, management and sign…☆45Nov 1, 2025Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Tutorial Materials for the paper "Evaluation & Benchmarking of LLM Agents: A Survey" published in KDD 2025 Conference.☆21Jun 12, 2026Updated last month
- gpt-rag-mcp☆22Jul 16, 2026Updated last week
- AGENT-FORGE is a Context Engineering Toolkit that generates GitHub Copilot customization files for your VS Code project. Instead of manua…☆74Apr 16, 2026Updated 3 months ago
- ☆32May 15, 2026Updated 2 months ago
- ☆149Feb 11, 2026Updated 5 months ago
- Guide for designing adaptive, scalable, and secure enterprise multi-agent systems☆224Dec 1, 2025Updated 7 months ago
- Declarative Agent Schema☆23Jul 10, 2026Updated 2 weeks ago
- Sample Solution with .NET Blazor to implement OpenAI ChatGPT☆11Mar 5, 2023Updated 3 years ago
- Foundry MCP playground (experimental)☆60Jul 21, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A library used for generating C# classes from DTDL interfaces.☆15Jul 9, 2024Updated 2 years ago
- ReMe: A Personalized Cognitive Training Framework Based on an LLM Voice Chatbot for Research☆18Jul 3, 2025Updated last year
- Composable AI Reference Architectures (CAIRA)☆223Updated this week
- Microsoft AI Value Accelerator☆33Jul 30, 2024Updated last year
- A versatile tool designed to help prototype intelligent assistants, agents and multi-agentic systems☆407Apr 1, 2026Updated 3 months ago
- This solution streamlines HR service workflows with an AI-powered assistant that delivers instant answers, automates record updates, and …☆27Nov 1, 2025Updated 8 months ago
- A sample app for the Multimodal Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure Op…☆68Jan 23, 2026Updated 6 months ago
- The Multi-Agent Custom Automation Engine Solution Accelerator is an AI-driven system that manages a group of AI agents to accomplish task…☆860Updated this week
- Free Chat and Agent usage analytics from log files☆17Jul 2, 2026Updated 3 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A MCP Server for Azure AI Foundry: it's now moved to cloud, check the new Foundry MCP Server☆252Jul 10, 2026Updated 2 weeks ago
- Collection of advanced usage scenarios for Semantic Kernel☆72Apr 21, 2026Updated 3 months ago
- Reference implementation of CLI interface for Amplifier project☆19Jul 15, 2026Updated last week
- This repo contains hands-on labs for building AI Agents using the Azure AI Agent Service SDK and Semantic Kernel. The Azure AI Agent Serv…☆82Feb 20, 2026Updated 5 months ago
- Develop pro-code personal agents integrated with memory service on Teams☆27Updated this week
- Embedded samples in Azure AI Foundry docs☆402Updated this week
- This project implements an agentic app using Magentic Orchestration from Semantic Kernel deployed on Azure Kubernetes Service. The system…☆15Jun 10, 2025Updated last year