Alternatives and similar repositories for MCPEval

Users that are interested in MCPEval are comparing it to the libraries listed below

• fairyshine / Chain-of-Tools
  The official implementation of the paper "Chain-of-Tools: Utilizing Massive Unseen Tools in the CoT Reasoning of Frozen Language Models".
  ☆87Updated 10 months ago
• microsoft / llm-steer-instruct
  A method for steering llms to better follow instructions
  ☆78Updated 6 months ago
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆132Updated this week
• DeepSoftwareAnalytics / Awesome-Agent4SE
  ☆106Updated last year
• jina-ai / jina-vdr
  Jina VDR is a multilingual, multi-domain benchmark for visual document retrieval
  ☆38Updated 6 months ago
• adityasoni9998 / OpenHands-Versa
  Code for the paper "Coding Agents with Multimodal Browsing are Generalist Problem Solvers"
  ☆97Updated 3 months ago
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆54Updated 3 weeks ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆261Updated this week
• miralab-ai / autoreason
  ☆39Updated last year
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆119Updated 9 months ago
• open-thoughts / OpenThoughts-Agent
  Data recipes and robust infrastructure for training AI agents
  ☆94Updated this week
• Dozi01 / MetaSPO
  ☆78Updated 4 months ago
• yueqis / API-Based-Agent
  ☆61Updated 7 months ago
• LLMSELECTOR / LLMSELECTOR
  ☆80Updated 4 months ago
• sony / talkhier
  Official Repo for The Paper "Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systems"
  ☆60Updated 11 months ago
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆76Updated last year
• youdotcom-oss / ydc-deep-research-evals
  you.com's framework for evaluating deep research systems.
  ☆67Updated 8 months ago
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆65Updated last year
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆30Updated last year
• sunnweiwei / PPP-Agent
  Training Proactive and Personalized LLM Agents
  ☆98Updated 3 weeks ago
• MinorJerry / OpenWebVoyager
  ☆87Updated last year
• SakanaAI / natural_niches
  The code repository of the paper: Competition and Attraction Improve Model Fusion
  ☆169Updated 5 months ago
• huggingface / screensuite
  ScreenSuite - The most comprehensive benchmarking suite for GUI Agents!
  ☆137Updated 4 months ago
• zjunlp / DynamicKnowledgeCircuits
  [ACL 2025] How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Training
  ☆47Updated 6 months ago
• OpenPipe / open_deep_research_training
  Training setup for Langchain's Open Deep Research
  ☆75Updated 5 months ago
• SalesforceAIResearch / perfcodegen
  ☆43Updated 3 months ago
• SalesforceAIResearch / MCP-Universe
  MCP-Universe is a comprehensive framework designed for developing, testing, and benchmarking AI agents
  ☆556Updated this week
• StigLidu / DualDistill
  [EMNLP 2025] The official implementation for paper "Agentic-R1: Distilled Dual-Strategy Reasoning"
  ☆102Updated 5 months ago
• jina-ai / submodular-optimization
  Submodular optimization for context engineering: query fan-out, text selection, passage reranking
  ☆78Updated 6 months ago
• javyduck / KnowHalu
  ☆50Updated last year