MCP-Bench: Benchmarking Tool-Using LLM Agents with Complex Real-World Tasks via MCP Servers
☆453Oct 7, 2025Updated 5 months ago
Alternatives and similar repositories for mcp-bench
Users that are interested in mcp-bench are comparing it to the libraries listed below
Sorting:
- MCP-Universe is a comprehensive framework designed for developing, testing, and benchmarking AI agents☆567Updated this week
- LiveMCPBench is a benchmark for evaluating the ability of agents to navigate and utilize a large-scale MCP toolset. It provides a compreh…☆93Dec 18, 2025Updated 2 months ago
- From Accuracy to Robustness: A Study of Rule- and Model-based Verifiers in Mathematical Reasoning.☆25Oct 7, 2025Updated 5 months ago
- On the Theoretical Limitations of Embedding-Based Retrieval☆634Sep 15, 2025Updated 5 months ago
- [ICLR-2026] Official Implementation of our paper "THOR: Tool-Integrated Hierarchical Optimization via RL for Mathematical Reasoning".☆32Feb 26, 2026Updated last week
- Official repo for "ProSec: Fortifying Code LLMs with Proactive Security Alignment"☆17Feb 26, 2026Updated last week
- The code for paper "EPO: Entropy-regularized Policy Optimization for LLM Agents Reinforcement Learning"☆37Oct 1, 2025Updated 5 months ago
- Official Code for our paper: "Language Models Learn to Mislead Humans via RLHF""☆19Oct 11, 2024Updated last year
- Anemoi: A Semi-Centralized Multi-agent Systems Based on Agent-to-Agent Communication MCP server from Coral Protocol☆373Aug 27, 2025Updated 6 months ago
- MUA-RL: MULTI-TURN USER-INTERACTING AGENT REINFORCEMENT LEARNING FOR AGENTIC TOOL USE☆57Nov 5, 2025Updated 4 months ago
- Repository of IPBench☆19Jan 4, 2026Updated 2 months ago
- A sophisticated CLI assistant to supercharge your Git workflow, powered by multiple AI providers.☆148Aug 20, 2025Updated 6 months ago
- A toolbox for backdoor attacks.☆23Jan 13, 2023Updated 3 years ago
- ☆22Apr 23, 2024Updated last year
- ☆12Jun 11, 2025Updated 8 months ago
- The official repository for the CodeGym project: "Generalizable End-to-End Tool-Use RL with Synthetic CodeGym"☆23Oct 14, 2025Updated 4 months ago
- ☆15Jan 12, 2026Updated last month
- Automate and streamline your job search with a suite of tools designed for LinkedIn outreach, email campaigns, resume organization, and n…☆12Oct 3, 2025Updated 5 months ago
- ☆14Feb 26, 2025Updated last year
- Library of Prefect tasks and utilities.☆10Oct 2, 2024Updated last year
- Code for "Adaptive Self-improvement LLM Agentic System for ML Library Development" (ICML 2025)☆15Jan 6, 2026Updated 2 months ago
- ☆10Sep 13, 2022Updated 3 years ago
- 🎉 TrustJudge is accepted to ICLR 2026!☆38Sep 27, 2025Updated 5 months ago
- A holistic framework for advancing LLMs as data science agents☆37Feb 3, 2026Updated last month
- ☆10Oct 31, 2022Updated 3 years ago
- A comprehensive benchmark for evaluating deep research agents on academic survey tasks☆50Sep 4, 2025Updated 6 months ago
- A comrephensive collection of learning from rewards in the post-training and test-time scaling of LLMs, with a focus on both reward model…☆64Jun 13, 2025Updated 8 months ago
- Code for "Can We Characterize Tasks Without Labels or Features?" (CVPR 2021)☆11Aug 31, 2021Updated 4 years ago
- [AAAI 2026] ReCode: Reinforced Code Knowledge Editing for API Updates☆23Jul 1, 2025Updated 8 months ago
- [ICLR 2025] Bridging and Modeling Correlations in Pairwise Data for Direct Preference Optimization☆12Jan 26, 2025Updated last year
- ☆12Feb 10, 2025Updated last year
- Sample, estimate, aggregate: A recipe for causal discovery foundation models☆17Jun 21, 2024Updated last year
- Reached #13 on Stanford's Terminal Bench leaderboard. Orchestrator, explorer & coder agents working together with intelligent context sha…☆1,338Nov 3, 2025Updated 4 months ago
- Plancraft is a minecraft environment and agent suite to test planning capabilities in LLMs☆26Nov 7, 2025Updated 4 months ago
- MCP server to search for jobs across multiple job listing platforms☆29Apr 30, 2025Updated 10 months ago
- Temporal activities and workflow stubs that wrap AWS Go SDK☆13Nov 9, 2020Updated 5 years ago
- 🚀 Thrilled to announce the successful wrap-up of Food Bazaar, a web app designed for convenient food and grocery delivery! 🍕🛒 This ex…☆12Jun 17, 2024Updated last year
- This is the repository for "SELECT: A Large-Scale Benchmark of Data Curation Strategies for Image Recognition"☆16Oct 8, 2024Updated last year
- ☆13May 17, 2025Updated 9 months ago