Alternatives and similar repositories for MCPEval

Users that are interested in MCPEval are comparing it to the libraries listed below

• fairyshine / Chain-of-Tools
  The official implementation of the paper "Chain-of-Tools: Utilizing Massive Unseen Tools in the CoT Reasoning of Frozen Language Models".
  ☆84Updated 7 months ago
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆125Updated last week
• jina-ai / jina-vdr
  Jina VDR is a multilingual, multi-domain benchmark for visual document retrieval
  ☆34Updated 3 months ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆101Updated this week
• microsoft / llm-steer-instruct
  A method for steering llms to better follow instructions
  ☆58Updated 3 months ago
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆76Updated 11 months ago
• jihoo-kim / awesome-context-engineering
  A curated list of awesome open-source libraries for context engineering (Long-term memory, MCP: Model Context Protocol, Prompt/RAG Compre…
  ☆96Updated 4 months ago
• sony / talkhier
  Official Repo for The Paper "Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systems"
  ☆57Updated 8 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆105Updated 7 months ago
• DeepSoftwareAnalytics / Awesome-Agent4SE
  ☆102Updated last year
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆117Updated 6 months ago
• miralab-ai / autoreason
  ☆40Updated 11 months ago
• yueqis / API-Based-Agent
  ☆60Updated 4 months ago
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆51Updated last year
• LLMSELECTOR / LLMSELECTOR
  ☆79Updated last month
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆65Updated last year
• yale-nlp / SciArena
  Analysis code for Neurips 2025 paper "SciArena: An Open Evaluation Platform for Foundation Models in Scientific Literature Tasks"
  ☆55Updated 3 months ago
• google / lmeval
  ☆235Updated 4 months ago
• OpenPipe / open_deep_research_training
  Training setup for Langchain's Open Deep Research
  ☆71Updated 2 months ago
• PathOnAIOrg / LiteWebAgent
  [NAACL2025] LiteWebAgent: The Open-Source Suite for VLM-Based Web-Agent Applications
  ☆128Updated 4 months ago
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆138Updated 2 months ago
• adityasoni9998 / OpenHands-Versa
  Code for the paper "Coding Agents with Multimodal Browsing are Generalist Problem Solvers"
  ☆92Updated 3 weeks ago
• SakanaAI / natural_niches
  The code repository of the paper: Competition and Attraction Improve Model Fusion
  ☆165Updated 2 months ago
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆79Updated 7 months ago
• ibm-granite / granite-guardian
  The Granite Guardian models are designed to detect risks in prompts and responses.
  ☆120Updated last month
• AlexCuadron / ThinkingAgent
  Systematic evaluation framework that automatically rates overthinking behavior in large language models.
  ☆94Updated 6 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆88Updated last week
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆111Updated 7 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆219Updated last year