Alternatives and similar repositories for LLM-Agent-Benchmark-List:

Users that are interested in LLM-Agent-Benchmark-List are comparing it to the libraries listed below

• hkust-nlp / AgentBoard
  An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]
  ☆307Updated 11 months ago
• zorazrw / awesome-tool-llm
  ☆221Updated 8 months ago
• facebookresearch / sweet_rl
  Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks
  ☆182Updated last week
• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆182Updated this week
• jwhj / OREO
  ☆107Updated 3 months ago
• rxlqn / awesome-llm-self-reflection
  augmented LLM with self reflection
  ☆119Updated last year
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆122Updated 10 months ago
• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆134Updated 4 months ago
• sambanova / toolbench
  ToolBench, an evaluation suite for LLM tool manipulation capabilities.
  ☆150Updated last year
• NumberChiffre / mcts-llm
  ☆93Updated 4 months ago
• SALT-NLP / DyLAN
  Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization
  ☆136Updated 11 months ago
• QwenLM / ProcessBench
  ☆149Updated 4 months ago
• InfiAgent / InfiAgent
  InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks (ICML 2024)
  ☆119Updated 4 months ago
• kohjingyu / search-agents
  Code for the paper 🌳 Tree Search for Language Model Agents
  ☆194Updated 9 months ago
• PRIME-RL / ImplicitPRM
  Repo of paper "Free Process Rewards without Process Labels"
  ☆143Updated last month
• Yu-Fangxu / FoR
  Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples
  ☆84Updated last month
• THUNLP-MT / StableToolBench
  A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.
  ☆142Updated last week
• Yifan-Song793 / ETO
  Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)
  ☆135Updated 5 months ago
• zjunlp / AutoAct
  [ACL 2024] AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planning
  ☆221Updated 3 months ago
• Ber666 / RAP
  Reasoning with Language Model is Planning with World Model
  ☆164Updated last year
• ScalerLab / JudgeBench
  ☆70Updated 5 months ago
• NingMiao / SelfCheck
  Code for the paper <SelfCheck: Using LLMs to Zero-Shot Check Their Own Step-by-Step Reasoning>
  ☆49Updated last year
• OSU-NLP-Group / WebDreamer
  "Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agents"
  ☆68Updated 2 weeks ago
• kanishkg / cognitive-behaviors
  ☆157Updated 3 weeks ago
• JoeYing1019 / UltraTool
  [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios
  ☆54Updated last year
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆120Updated 7 months ago
• thunlp / Optima
  Code for paper "Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System"
  ☆56Updated 5 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆209Updated last week
• zjunlp / WorfBench
  [ICLR 2025] Benchmarking Agentic Workflow Generation
  ☆79Updated 2 months ago
• hkust-nlp / dart-math
  [NeurIPS'24] Official code for *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*
  ☆101Updated 4 months ago