A Node.js package and GitHub Action for evaluating MCP (Model Context Protocol) tool implementations using LLM-based scoring. This helps ensure your MCP server's tools are working correctly and performing well.
☆133Jun 23, 2025Updated last year
Alternatives and similar repositories for mcp-evals
Users that are interested in mcp-evals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A high performance MCP client sdk for python☆18Apr 8, 2025Updated last year
- An open-ended eval framework for mcp.run tools☆22May 22, 2025Updated last year
- MCP Community Working Group repository☆67Nov 23, 2025Updated 9 months ago
- ☆32Apr 16, 2025Updated last year
- Enterprise Governance Layer (Identity, RBAC, Credentials, Auditing, Logging, Tracing) for the Model Context Protocol SDK☆39Apr 4, 2025Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- MCP (Model Context Protocol) Servers authored and maintained by the PulseMCP team. We build reliable servers thoughtfully designed specif…☆80Aug 30, 2026Updated last week
- [DEPRECATED] Superseded by systempromptio/systemprompt-template and systempromptio/systemprompt-core. Reference MCP server implementation…☆103Apr 21, 2026Updated 4 months ago
- ☆12Jan 7, 2025Updated last year
- Testing and evaluation platform to chat, inspect, and debug MCP servers, MCP apps, and ChatGPT apps.☆2,188Updated this week
- ScaledMCP is a horizontally scalabled MCP and A2A Server. You know, for AI.☆43Aug 11, 2025Updated last year
- TypeScript SDK for MCP server observability, built on OpenTelemetry. Gain insight into agent usage patterns, contextualize tool calls, an…☆68Dec 8, 2025Updated 8 months ago
- Remote MCP server (SEE + Streamable HTTP) implementing the MCP spec's authorization extension. Use directly from your agents, or from Cur…☆107May 7, 2025Updated last year
- Visual testing tool for MCP servers - on steroids☆37Jun 5, 2025Updated last year
- Universal MCP IdP (Identity Provider) - Support Thousands of Integrations, Zero Maintenance☆30Dec 25, 2025Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Index of all Model Context Protocol (MCP) clients and their capabilities☆80Updated this week
- Transports Working Group☆18Updated this week
- 🔧🔌 Prototype for programmatically calling and composing MCP tools☆43Feb 23, 2026Updated 6 months ago
- CLI-based tester for verifying that MCP servers work correctly when called directory and by agents☆35Sep 16, 2025Updated 11 months ago
- MCP server for the windows API.☆22Apr 22, 2025Updated last year
- Agentic Resource Discovery Client/Server☆41Jul 28, 2026Updated last month
- A CLI inspector for the Model Context Protocol☆443Jun 8, 2026Updated 3 months ago
- MCP server for Jupyter Notebooks and JupyterLab☆32Feb 1, 2025Updated last year
- MCP server that runs a directed graph of MCP servers☆21Jan 5, 2026Updated 8 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- playbooks for AI agents. makes life easier by helping your agent complete common multi-step tasks autonomously.☆20Aug 9, 2025Updated last year
- [DEPRECATED] Superseded by systempromptio/systemprompt-template and systempromptio/systemprompt-core. Multi-modal MCP client for voice-po…☆211Apr 21, 2026Updated 4 months ago
- An MCP server that hosts finite state machines as dynamic resources that multiple clients can subscribe to and be updated when their stat…☆31Aug 24, 2025Updated last year
- Playwright-based testing and eval framework for MCP servers with LLM-as-a-judge☆19Updated this week
- Universal LLM security auditor with automated jailbreak testing, DSPy optimization, and OWASP 2025-aligned attack patterns☆22Oct 23, 2025Updated 10 months ago
- An extension to MCP (Model-Context-Protocol) that enables two-way asynchronous communication between LLMs and tools through the already e…☆34Apr 4, 2025Updated last year
- Capture live images from your webcam with a tool or resource request☆120Oct 22, 2025Updated 10 months ago
- A Model Context Protocol (MCP) server that provides enhanced file operation capabilities with streaming, patching, and change tracking su…☆21Jul 11, 2025Updated last year
- Modern MCP Inspector for remote mcp servers with support for Apps SDK☆26Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [DEPRECATED] Superseded by systempromptio/systemprompt-template and systempromptio/systemprompt-core. MCP server for orchestrating AI cod…☆140Apr 21, 2026Updated 4 months ago
- Status: Experimental. This repository provides a multi-language reference implementation of the proposed interceptor extension for the Mo…☆23Aug 28, 2026Updated last week
- Provides summarised output from various actions that could otherwise eat up tokens and cause crashes for AI agents☆37Jun 15, 2025Updated last year
- a web logging proxy for MCP client-server communication☆31May 29, 2026Updated 3 months ago
- Aggregate 100.000s of files in a Durable Object, streaming out to R2, circumventing limitations☆32May 15, 2025Updated last year
- The official toolprint SDK in typescript☆40Feb 16, 2026Updated 6 months ago
- A command-line interface for interacting with MCP (Model Context Protocol) servers using both stdio and HTTP transport.☆1,623Dec 18, 2025Updated 8 months ago