A Node.js package and GitHub Action for evaluating MCP (Model Context Protocol) tool implementations using LLM-based scoring. This helps ensure your MCP server's tools are working correctly and performing well.
☆134Jun 23, 2025Updated last year
Alternatives and similar repositories for mcp-evals
Users that are interested in mcp-evals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MCP Community Working Group repository☆67Nov 23, 2025Updated 11 months ago
- MCP Alignment & Linting Tool☆13Updated this week
- Enterprise Governance Layer (Identity, RBAC, Credentials, Auditing, Logging, Tracing) for the Model Context Protocol SDK☆39Apr 4, 2025Updated last year
- MCP (Model Context Protocol) Servers authored and maintained by the PulseMCP team. We build reliable servers thoughtfully designed specif…☆81Oct 9, 2026Updated 3 weeks ago
- ☆16Jun 2, 2026Updated 5 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [DEPRECATED] Superseded by systempromptio/systemprompt-template and systempromptio/systemprompt-core. Reference MCP server implementation…☆103Apr 21, 2026Updated 6 months ago
- Testing and evaluation platform to chat, inspect, and debug MCP servers, MCP apps, and ChatGPT apps.☆2,301Updated this week
- TypeScript SDK for MCP server observability, built on OpenTelemetry. Gain insight into agent usage patterns, contextualize tool calls, an…☆68Dec 8, 2025Updated 10 months ago
- Lightweight eval framework for MCP servers, built on mcp-agent☆41Nov 19, 2025Updated 11 months ago
- Remote MCP server (SEE + Streamable HTTP) implementing the MCP spec's authorization extension. Use directly from your agents, or from Cur…☆110May 7, 2025Updated last year
- Universal MCP IdP (Identity Provider) - Support Thousands of Integrations, Zero Maintenance☆30Dec 25, 2025Updated 10 months ago
- ☆11Oct 26, 2026Updated last week
- Index of all Model Context Protocol (MCP) clients and their capabilities☆80Sep 2, 2026Updated 2 months ago
- CLI-based tester for verifying that MCP servers work correctly when called directory and by agents☆35Sep 16, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A Swift SDK for Claude Code, providing programmatic access to Claude's powerful code generation and assistance capabilities through a typ…☆26Aug 16, 2025Updated last year
- A CLI inspector for the Model Context Protocol☆447Jun 8, 2026Updated 4 months ago
- About experimental exploration of organization for MCP primitives. Maintained by the Primitive Grouping Interest Group.☆16Oct 27, 2026Updated last week
- Use as many MCP servers as you want while minimizing context usage. A code mode MCP server gateway driven with Lua 🌙☆15Oct 5, 2026Updated last month
- Playwright-based testing and eval framework for MCP servers with LLM-as-a-judge☆19Updated this week
- Universal LLM security auditor with automated jailbreak testing, DSPy optimization, and OWASP 2025-aligned attack patterns☆22Oct 23, 2025Updated last year
- [DEPRECATED] Superseded by systempromptio/systemprompt-template and systempromptio/systemprompt-core. Multi-modal MCP client for voice-po…☆209Apr 21, 2026Updated 6 months ago
- Transports Working Group☆24Updated this week
- An MCP server that hosts finite state machines as dynamic resources that multiple clients can subscribe to and be updated when their stat…☆33Aug 24, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- MCP server that runs a directed graph of MCP servers☆22Jan 5, 2026Updated 10 months ago
- An OAuth 2.1 Authorization Server that adds authentication to any MCP (Model Context Protocol) server without code modification.☆60Aug 16, 2025Updated last year
- Capture live images from your webcam with a tool or resource request☆126Oct 22, 2025Updated last year
- Conformance Tests for MCP☆140Updated this week
- MCP server for the windows API.☆23Apr 22, 2025Updated last year
- Open Memory Protocol (OMP): an open protocol for moving and sharing AI-agent memory. Hosted at the AI Disclosures Project, co-convened wi…☆28Updated this week
- a web logging proxy for MCP client-server communication☆32May 29, 2026Updated 5 months ago
- AI-powered local MCP server for terminal commands, surgical file editing, process management, and intelligent codebase exploration. FastM…☆14Apr 7, 2025Updated last year
- This GitHub Action takes changes from the Git working directory and applies them as GitHub code review suggestions.☆22Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Modern MCP Inspector for remote mcp servers with support for Apps SDK☆28Updated this week
- ACP Kit provides a common adapter for Agent Frameworks.☆23Updated this week
- Provides summarised output from various actions that could otherwise eat up tokens and cause crashes for AI agents☆37Jun 15, 2025Updated last year
- The AI control plane for every agent in your enterprise, built around an enterprise-grade MCP gateway. Give each team one governed path t…☆277Updated this week
- Allow AI to wade through complex OpenAPIs using Simple Language☆905Jul 7, 2026Updated 4 months ago
- Ecdysis: Efficient and Effective Training of Runtime Harnesses for LLM Agents☆14Sep 22, 2026Updated last month
- Status: Experimental. This repository provides a multi-language reference implementation of the proposed interceptor extension for the Mo…☆23Oct 29, 2026Updated last week