Alternatives and similar repositories for MCPEval

Users that are interested in MCPEval are comparing it to the libraries listed below

• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆126Updated last month
• fairyshine / Chain-of-Tools
  The official implementation of the paper "Chain-of-Tools: Utilizing Massive Unseen Tools in the CoT Reasoning of Frozen Language Models".
  ☆85Updated 9 months ago
• microsoft / llm-steer-instruct
  A method for steering llms to better follow instructions
  ☆68Updated 4 months ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆249Updated this week
• adityasoni9998 / OpenHands-Versa
  Code for the paper "Coding Agents with Multimodal Browsing are Generalist Problem Solvers"
  ☆94Updated 2 months ago
• sony / talkhier
  Official Repo for The Paper "Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systems"
  ☆59Updated 10 months ago
• SakanaAI / natural_niches
  The code repository of the paper: Competition and Attraction Improve Model Fusion
  ☆169Updated 4 months ago
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆53Updated last year
• sunnweiwei / PPP-Agent
  ☆93Updated last month
• DeepSoftwareAnalytics / Awesome-Agent4SE
  ☆105Updated last year
• jina-ai / jina-vdr
  Jina VDR is a multilingual, multi-domain benchmark for visual document retrieval
  ☆37Updated 4 months ago
• PathOnAIOrg / LiteWebAgent
  [NAACL2025] LiteWebAgent: The Open-Source Suite for VLM-Based Web-Agent Applications
  ☆140Updated 5 months ago
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆76Updated last year
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆140Updated 4 months ago
• MinorJerry / OpenWebVoyager
  ☆85Updated last year
• Columbia-NLP-Lab / PAPILLON
  Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles
  ☆61Updated 7 months ago
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆80Updated 8 months ago
• pgasawa / BARE
  Leveraging Base Language Models for Few-Shot Synthetic Data Generation
  ☆40Updated 2 months ago
• huggingface / screensuite
  ScreenSuite - The most comprehensive benchmarking suite for GUI Agents!
  ☆133Updated 3 months ago
• OpenHands / software-agent-sdk
  A clean, modular SDK for building AI agents with OpenHands V1.
  ☆371Updated this week
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆111Updated 8 months ago
• jihoo-kim / awesome-context-engineering
  A curated list of awesome open-source libraries for context engineering (Long-term memory, MCP: Model Context Protocol, Prompt/RAG Compre…
  ☆101Updated 5 months ago
• Dozi01 / MetaSPO
  ☆73Updated 3 months ago
• LLMSELECTOR / LLMSELECTOR
  ☆79Updated 3 months ago
• Danau5tin / Orca-Agent-RL
  Scaling Coding-Agent RL to 32x H100s. **Achieving 160% improvement** on Stanford's TerminalBench
  ☆88Updated last month
• miralab-ai / autoreason
  ☆40Updated last year
• agora-protocol / paper-demo
  ☆173Updated 9 months ago
• SalesforceAIResearch / MCP-Universe
  MCP-Universe is a comprehensive framework designed for developing, testing, and benchmarking AI agents
  ☆531Updated this week
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆89Updated 7 months ago
• microsoft / lost_in_conversation
  Code that accompanies the public release of the paper Lost in Conversation (https://arxiv.org/abs/2505.06120)
  ☆195Updated 6 months ago