Github action to evaluate AI agent applications using model as the judge, content safety and mathematical metrics.
☆105May 20, 2026Updated 4 months ago
Alternatives and similar repositories for ai-agent-evals
Users that are interested in ai-agent-evals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GitAGU (Git Agent Unblock) - A centralized platform for discovering, configuring, and integrating AI agents into your development workflo…☆31Sep 14, 2026Updated last week
- An agentic evaluation framework☆23Feb 11, 2026Updated 7 months ago
- ☆29Updated this week
- The LLMAgentOps Toolkit is a repository that provides a foundational structure for building LLM Agent-based applications using the Semant…☆19Apr 1, 2026Updated 5 months ago
- Implement GenAIOps using Azure AI Foundry with ease and jumpstart☆27Jul 10, 2026Updated 2 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- 🤖 How GitHub Copilot has grown and changed 💡 Exciting new features and updates 📺 A live Copilot demo in action☆19Sep 14, 2026Updated last week
- AI demos at the Expert Meetup booths showcasing models, agents, and tools.☆53May 29, 2025Updated last year
- SK Multi agentic advanced orchestration example☆17Feb 20, 2026Updated 7 months ago
- A repository that uses LLMs to evaluate other LLMs in a structured way☆39Feb 11, 2026Updated 7 months ago
- ☆24Nov 6, 2025Updated 10 months ago
- This repository hosts the instructions and workshop materials for Lab 331 (Deep Research with Langchain and DeepSeek R1) for Microsoft Bu…☆26Jun 5, 2025Updated last year
- MCP server for Fabric Real-Time Intelligence (https://aka.ms/fabricrti) supporting tools for Eventhouse (https://aka.ms/eventhouse), Azur…☆132Updated this week
- Solution Accelerator to show how to deploy an Agent configured in Copilot Studio to streamline NDA document creation, management and sign…☆47Nov 1, 2025Updated 10 months ago
- Tutorial Materials for the paper "Evaluation & Benchmarking of LLM Agents: A Survey" published in KDD 2025 Conference.☆21Jun 12, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- gpt-rag-mcp☆22Sep 18, 2026Updated last week
- AGENT-FORGE is a Context Engineering Toolkit that generates GitHub Copilot customization files for your VS Code project. Instead of manua…☆87Apr 16, 2026Updated 5 months ago
- ☆33May 15, 2026Updated 4 months ago
- ☆149Feb 11, 2026Updated 7 months ago
- Guide for designing adaptive, scalable, and secure enterprise multi-agent systems☆237Aug 10, 2026Updated last month
- Declarative Agent Schema☆27Jul 10, 2026Updated 2 months ago
- Sample Solution with .NET Blazor to implement OpenAI ChatGPT☆11Mar 5, 2023Updated 3 years ago
- Foundry MCP playground (experimental)☆62Jul 21, 2025Updated last year
- A library used for generating C# classes from DTDL interfaces.☆15Jul 9, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ReMe: A Personalized Cognitive Training Framework Based on an LLM Voice Chatbot for Research☆18Jul 3, 2025Updated last year
- Composable AI Reference Architectures (CAIRA)☆229Updated this week
- Microsoft AI Value Accelerator☆33Jul 30, 2024Updated 2 years ago
- This solution streamlines HR service workflows with an AI-powered assistant that delivers instant answers, automates record updates, and …☆28Nov 1, 2025Updated 10 months ago
- A sample app for the Multimodal Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure Op…☆67Jan 23, 2026Updated 8 months ago
- The Multi-Agent Custom Automation Engine Solution Accelerator is an AI-driven system that manages a group of AI agents to accomplish task…☆886Updated this week
- Free Chat and Agent usage analytics from log files☆21Jul 2, 2026Updated 2 months ago
- A MCP Server for Azure AI Foundry: it's now moved to cloud, check the new Foundry MCP Server☆260Jul 10, 2026Updated 2 months ago
- Collection of advanced usage scenarios for Semantic Kernel☆73Apr 21, 2026Updated 5 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Reference implementation of CLI interface for Amplifier project☆19Updated this week
- This repo contains hands-on labs for building AI Agents using the Azure AI Agent Service SDK and Semantic Kernel. The Azure AI Agent Serv…☆86Feb 20, 2026Updated 7 months ago
- Develop pro-code personal agents integrated with memory service on Teams☆28Updated this week
- Samples for Microsoft Foundry platform☆450Updated this week
- A comprehensive set of samples of creating and using MCP servers and clients with .NET☆196Updated this week
- This project implements an agentic app using Magentic Orchestration from Semantic Kernel deployed on Azure Kubernetes Service. The system…☆16Jun 10, 2025Updated last year
- ☆31Aug 24, 2026Updated last month