A Node.js package and GitHub Action for evaluating MCP (Model Context Protocol) tool implementations using LLM-based scoring. This helps ensure your MCP server's tools are working correctly and performing well.
☆134Jun 23, 2025Updated last year
Alternatives and similar repositories for mcp-evals
Users that are interested in mcp-evals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A high performance MCP client sdk for python☆18Apr 8, 2025Updated last year
- MCP Community Working Group repository☆67Nov 23, 2025Updated 10 months ago
- An open-ended eval framework for mcp.run tools☆22May 22, 2025Updated last year
- Enterprise Governance Layer (Identity, RBAC, Credentials, Auditing, Logging, Tracing) for the Model Context Protocol SDK☆39Apr 4, 2025Updated last year
- MCP (Model Context Protocol) Servers authored and maintained by the PulseMCP team. We build reliable servers thoughtfully designed specif…☆81Oct 9, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆16Jun 2, 2026Updated 4 months ago
- [DEPRECATED] Superseded by systempromptio/systemprompt-template and systempromptio/systemprompt-core. Reference MCP server implementation…☆104Apr 21, 2026Updated 5 months ago
- Testing framework for Model Context Protocol (MCP)☆29Apr 19, 2025Updated last year
- Testing and evaluation platform to chat, inspect, and debug MCP servers, MCP apps, and ChatGPT apps.☆2,268Updated this week
- ScaledMCP is a horizontally scalabled MCP and A2A Server. You know, for AI.☆43Aug 11, 2025Updated last year
- TypeScript SDK for MCP server observability, built on OpenTelemetry. Gain insight into agent usage patterns, contextualize tool calls, an…☆68Dec 8, 2025Updated 10 months ago
- Universal MCP IdP (Identity Provider) - Support Thousands of Integrations, Zero Maintenance☆30Dec 25, 2025Updated 9 months ago
- Index of all Model Context Protocol (MCP) clients and their capabilities☆79Sep 2, 2026Updated last month
- 🔧🔌 Prototype for programmatically calling and composing MCP tools☆43Feb 23, 2026Updated 7 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Transports Working Group☆24Oct 9, 2026Updated last week
- CLI-based tester for verifying that MCP servers work correctly when called directory and by agents☆35Sep 16, 2025Updated last year
- Agentic Resource Discovery Client/Server☆46Sep 29, 2026Updated 2 weeks ago
- A Swift SDK for Claude Code, providing programmatic access to Claude's powerful code generation and assistance capabilities through a typ…☆27Aug 16, 2025Updated last year
- MCP server that runs a directed graph of MCP servers☆22Jan 5, 2026Updated 9 months ago
- A CLI inspector for the Model Context Protocol☆446Jun 8, 2026Updated 4 months ago
- [DEPRECATED] Superseded by systempromptio/systemprompt-template and systempromptio/systemprompt-core. Multi-modal MCP client for voice-po…☆209Apr 21, 2026Updated 5 months ago
- MCP server for Jupyter Notebooks and JupyterLab☆34Feb 1, 2025Updated last year
- An MCP server that hosts finite state machines as dynamic resources that multiple clients can subscribe to and be updated when their stat…☆32Aug 24, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Conformance Tests for MCP☆136Updated this week
- Capture live images from your webcam with a tool or resource request☆123Oct 22, 2025Updated 11 months ago
- Create a new MCP server in TypeScript, batteries included.☆21Apr 23, 2025Updated last year
- An MCP server to read MCP logs to debug directly inside the client☆16May 3, 2025Updated last year
- MCP-based assistant for busy people who are context switching☆36Jun 3, 2025Updated last year
- a web logging proxy for MCP client-server communication☆32May 29, 2026Updated 4 months ago
- Aggregate 100.000s of files in a Durable Object, streaming out to R2, circumventing limitations☆32May 15, 2025Updated last year
- The open archive of how AI agents actually work. A versioned, verifiable archive of system prompts, developer instructions, tool schemas…☆74Oct 1, 2026Updated 2 weeks ago
- Status: Experimental. This repository provides a multi-language reference implementation of the proposed interceptor extension for the Mo…☆23Sep 29, 2026Updated 2 weeks ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A fast pure-Python search engine☆12Apr 9, 2009Updated 17 years ago
- playbooks for AI agents. makes life easier by helping your agent complete common multi-step tasks autonomously.☆20Aug 9, 2025Updated last year
- Code, Build and Evaluate agents - excellent Model and Skills/MCP/ACP/A2A Support☆3,939Updated this week
- ☆63Apr 13, 2026Updated 6 months ago
- Hugging Face MCP Server☆305Updated this week
- Allow AI to wade through complex OpenAPIs using Simple Language☆903Jul 7, 2026Updated 3 months ago
- Allows Honeycomb Enterprise customers to use AI to query and analyze their data, alerts, dashboards, and more; and cross-reference produc…☆43Aug 21, 2025Updated last year