icip-cas / LiveMCPBenchLinks
LiveMCPBench is a benchmark for evaluating the ability of agents to navigate and utilize a large-scale MCP toolset. It provides a comprehensive set of tasks that challenge agents to effectively use various tools in daily scenarios.
☆71Updated 3 months ago
Alternatives and similar repositories for LiveMCPBench
Users that are interested in LiveMCPBench are comparing it to the libraries listed below
Sorting:
- ☆118Updated this week
- [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆115Updated 6 months ago
- Code that accompanies the public release of the paper Lost in Conversation (https://arxiv.org/abs/2505.06120)☆189Updated 5 months ago
- Complex Function Calling Benchmark.☆149Updated 10 months ago
- SSRL: Self-Search Reinforcement Learning☆158Updated 3 months ago
- [NeurIPS'25 D&B] Mind2Web-2 Benchmark: Evaluating Agentic Search with Agent-as-a-Judge☆93Updated 2 weeks ago
- ☆93Updated 2 weeks ago
- ☆104Updated 2 months ago
- ☆35Updated 6 months ago
- Code for the paper "Coding Agents with Multimodal Browsing are Generalist Problem Solvers"☆93Updated last month
- Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory☆218Updated 6 months ago
- A dataset for training and evaluating LLMs on decision making about "when (not) to call" functions☆43Updated 7 months ago
- The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution☆171Updated this week
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆113Updated last week
- Official Code Repository for the paper "Distilling LLM Agent into Small Models with Retrieval and Code Tools"☆177Updated last month
- [NeurIPS 2024] Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?☆135Updated last year
- General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]☆209Updated 2 weeks ago
- Code for paper "Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System"☆67Updated last year
- LIMI: Less is More for Agency☆153Updated last month
- ☆106Updated last year
- ☆84Updated last month
- [ICML 2025] Satori: Reinforcement Learning with Chain-of-Action-Thought Enhances LLM Reasoning via Autoregressive Search☆109Updated 6 months ago
- ☆32Updated last year
- [ACL 2025] RetroLLM: Empowering LLMs to Retrieve Fine-grained Evidence within Generation☆118Updated 10 months ago
- SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoning☆85Updated last week
- Demystifying Reinforcement Learning in Agentic Reasoning☆126Updated last month
- [ACL 2025] Agentic Knowledgeable Self-awareness☆91Updated 5 months ago
- ☆158Updated 2 months ago
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆94Updated 6 months ago
- DeepDive: Advancing Deep Search Agents with Knowledge Graphs and Multi-Turn RL☆211Updated 2 months ago