Alternatives and similar repositories for MCPEval

Users that are interested in MCPEval are comparing it to the libraries listed below

• fairyshine / Chain-of-Tools
  The official implementation of the paper "Chain-of-Tools: Utilizing Massive Unseen Tools in the CoT Reasoning of Frozen Language Models".
  ☆85Updated 6 months ago
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆118Updated 3 months ago
• jina-ai / jina-vdr
  Jina VDR is a multilingual, multi-domain benchmark for visual document retrieval
  ☆30Updated 2 months ago
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆75Updated 10 months ago
• SalesforceAIResearch / SFR-RAG
  ☆78Updated 8 months ago
• DeepSoftwareAnalytics / Awesome-Agent4SE
  ☆100Updated last year
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆96Updated this week
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆56Updated 10 months ago
• adityasoni9998 / OpenHands-Versa
  Code for the paper "Coding Agents with Multimodal Browsing are Generalist Problem Solvers"
  ☆86Updated this week
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆50Updated last year
• microsoft / llm-steer-instruct
  A method for steering llms to better follow instructions
  ☆53Updated 2 months ago
• flowaicom / flow-judge
  Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…
  ☆78Updated 11 months ago
• jihoo-kim / awesome-context-engineering
  A curated list of awesome open-source libraries for context engineering (Long-term memory, MCP: Model Context Protocol, Prompt/RAG Compre…
  ☆92Updated 3 months ago
• miralab-ai / autoreason
  ☆40Updated 9 months ago
• javyduck / KnowHalu
  ☆48Updated last year
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆89Updated 5 months ago
• huggingface / screensuite
  ScreenSuite - The most comprehensive benchmarking suite for GUI Agents!
  ☆123Updated last week
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆212Updated last year
• Columbia-NLP-Lab / PAPILLON
  Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles
  ☆56Updated 5 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆111Updated 6 months ago
• LLMSELECTOR / LLMSELECTOR
  ☆78Updated last week
• jina-ai / llm-query-expansion
  Query Expension for Better Query Embedding using LLMs
  ☆57Updated 7 months ago
• darshil3011 / AutoMetaRAG
  Dynamic Metadata based RAG Framework
  ☆75Updated last year
• microsoft / EvoPrompt
  Automatic Prompt Optimization
  ☆45Updated last year
• sony / talkhier
  Official Repo for The Paper "Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systems"
  ☆57Updated 7 months ago
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆102Updated 2 months ago
• Nardien / agent-distillation
  Official Code Repository for the paper "Distilling LLM Agent into Small Models with Retrieval and Code Tools"
  ☆156Updated 2 months ago
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆135Updated last month
• SakanaAI / natural_niches
  The code repository of the paper: Competition and Attraction Improve Model Fusion
  ☆159Updated last month
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆87Updated 3 weeks ago