eval-sys / mcpmarkLinks
MCPMark is a comprehensive, stress-testing MCP benchmark designed to evaluate model and agent capabilities in real-world MCP use.
☆342Updated last week
Alternatives and similar repositories for mcpmark
Users that are interested in mcpmark are comparing it to the libraries listed below
Sorting:
- Official repo of Toucan: Synthesizing 1.5M Tool-Agentic Data from Real-World MCP Environments☆185Updated 2 months ago
- Deep Research☆303Updated 3 months ago
- MrlX: A Multi-Agent Reinforcement Learning Framework☆153Updated 2 weeks ago
- DeepDive: Advancing Deep Search Agents with Knowledge Graphs and Multi-Turn RL☆211Updated 2 months ago
- WideSearch: Benchmarking Agentic Broad Info-Seeking☆104Updated 2 months ago
- Draft-Target Disaggregation LLM Serving System via Parallel Speculative Decoding.☆126Updated last month
- The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution☆171Updated this week
- Implementation for OAgents: An Empirical Study of Building Effective Agents☆291Updated 2 months ago
- Computer Agent Arena: Test & compare AI agents in real desktop apps & web environments. Code/data coming soon!☆51Updated 8 months ago
- Data Synthesis for Deep Research Based on Semi-Structured Data☆183Updated last month
- SE-Agent is a self-evolution framework for LLM Code agents. It enables trajectory-level evolution to exchange information across reasonin…☆200Updated 2 months ago
- A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning☆280Updated 2 months ago
- ☆142Updated 7 months ago
- Omni Model Benchmark with high quality and diversity, which reveals the Compositional Law. We’re now focused on Chinese scenarios — and a…☆75Updated this week
- [ACL 2025] AgentStore: Scalable Integration of Heterogeneous Agents As Specialized Generalist Computer Assistant☆42Updated 11 months ago
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆254Updated 7 months ago
- ☆73Updated 2 months ago
- Agent KB: Leveraging Cross-Domain Experience for Agentic Problem Solving☆401Updated 3 months ago
- Revisiting Mid-training in the Era of Reinforcement Learning Scaling☆181Updated 4 months ago
- ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimization☆93Updated 6 months ago
- [NeurIPS 2025] The official repo of SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyond☆187Updated 5 months ago
- [NeurIPS 2024 D&B Track] GTA: A Benchmark for General Tool Agents☆130Updated 8 months ago
- [EMNLP 2025] RAG-Instruct: Boosting LLMs with Diverse Retrieval-Augmented Instructions☆136Updated 8 months ago
- ☆85Updated 8 months ago
- ☆255Updated last week
- DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents☆506Updated 3 weeks ago
- SSRL: Self-Search Reinforcement Learning☆158Updated 3 months ago
- ☆50Updated 2 months ago
- ☆105Updated last year
- ☆155Updated last month