Lightweight eval framework for MCP servers, built on mcp-agent
☆30Nov 19, 2025Updated 8 months ago
Alternatives and similar repositories for mcp-eval
Users that are interested in mcp-eval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Building example collaborative filtering recommender systems with RecommenderLab package in R. Example code is borrowed and modified from…☆12Oct 15, 2017Updated 8 years ago
- Automate RMarkdown Reporting☆13Mar 29, 2021Updated 5 years ago
- LLM code editor for backend services☆16Oct 19, 2024Updated last year
- Repository for paper "Building(s and) cities:Delineating urban areas with a machine learning algorithm", by Dani Arribas-Bel, Miquel-Ange…☆12Jan 7, 2020Updated 6 years ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆35Apr 17, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- a CLI and set of agent skills to prototype custom scenes with coding agents like Codex and Claude Code.☆15May 28, 2026Updated last month
- An Open Source SLM Trained for MCP☆23May 18, 2025Updated last year
- Entropy Based Sampling and Parallel CoT Decoding☆17Oct 9, 2024Updated last year
- A command line tool to execute simple file conversions, image/video manipulations and folder changes.☆16Jul 8, 2024Updated 2 years ago
- ☆16Feb 22, 2026Updated 4 months ago
- A distributed work-item database for agent swarms, using git as the sync layer☆24Updated this week
- Structured outputs from DSPy and Jinja2☆27Jun 27, 2025Updated last year
- Official Documentation for DSPy Library☆25Jul 14, 2026Updated last week
- A Node.js package and GitHub Action for evaluating MCP (Model Context Protocol) tool implementations using LLM-based scoring. This helps …☆130Jun 23, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆29Jan 18, 2023Updated 3 years ago
- ☆18Jun 5, 2026Updated last month
- Lighter than feather, Harder than steel, RL Framework☆24Mar 26, 2026Updated 3 months ago
- Simple provider agnostic LLM gateway☆20Updated this week
- Collection of outlines for Turing classes☆24Feb 6, 2017Updated 9 years ago
- A collection of Python notebooks to get you started with Semantic Kernel quickly.☆16Oct 8, 2023Updated 2 years ago
- Scalable, cloud-native infrastructure for evaluating AI agents across any benchmark.☆26Updated this week
- A couple scripts to grab stats from email☆43Sep 10, 2024Updated last year
- Prevent processes from taking down your machine or making it unresponsive.☆31Jun 12, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Build Web Datasets with Ease☆33Jun 23, 2024Updated 2 years ago
- Granite Code Cookbook☆50Jun 10, 2026Updated last month
- Python library to add support for embedding natural code in Python with shared program state.☆30Jan 20, 2026Updated 6 months ago
- Code for paper: "Executing Arithmetic: Fine-Tuning Large Language Models as Turing Machines"☆11Oct 11, 2024Updated last year
- Problem-Oriented Segmentation and Retrieval EMNLP 2024 Findings☆34Nov 12, 2024Updated last year
- 🤖 Open-source LLM server (OpenAI, Ollama, Groq, Anthropic) with support for HTTP, Streaming, Agents, RAG (Deprecated check out Orchestra…☆33Jun 10, 2025Updated last year
- LLM benchmarks☆13Feb 22, 2024Updated 2 years ago
- Knowledge Graph based Question Answering benchmark.☆10Feb 1, 2020Updated 6 years ago
- ☆42Jun 18, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Code and data for automatic paraphrase dataset augmentation.☆11Mar 8, 2021Updated 5 years ago
- ☆11Jan 3, 2024Updated 2 years ago
- Align, a general text alignment function☆15Dec 7, 2023Updated 2 years ago
- ☆11Nov 5, 2024Updated last year
- Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.☆51Sep 29, 2024Updated last year
- LGEB: Benchmark of Language Generation Evaluation☆16Oct 21, 2022Updated 3 years ago
- SpecMem: 🧠 Unified Agent Experience and Cognitive Memory for Every Coding Agent☆31Jun 4, 2026Updated last month