Alternatives and similar repositories for LLM-Agent-Benchmark-List

Users that are interested in LLM-Agent-Benchmark-List are comparing it to the libraries listed below

• zorazrw / awesome-tool-llm
  ☆228Updated 9 months ago
• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆193Updated this week
• rxlqn / awesome-llm-self-reflection
  augmented LLM with self reflection
  ☆121Updated last year
• hkust-nlp / AgentBoard
  An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]
  ☆313Updated 11 months ago
• SALT-NLP / DyLAN
  Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization
  ☆143Updated 11 months ago
• zjunlp / WKM
  [NeurIPS 2024] Agent Planning with World Knowledge Model
  ☆134Updated 4 months ago
• facebookresearch / sweet_rl
  Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks
  ☆193Updated last week
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆123Updated 11 months ago
• NumberChiffre / mcts-llm
  ☆94Updated 5 months ago
• QwenLM / ProcessBench
  ☆151Updated 4 months ago
• Yifan-Song793 / ETO
  Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)
  ☆139Updated 6 months ago
• zjunlp / WorfBench
  [ICLR 2025] Benchmarking Agentic Workflow Generation
  ☆92Updated 2 months ago
• THUNLP-MT / StableToolBench
  A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.
  ☆147Updated last month
• thunlp / Optima
  Code for paper "Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System"
  ☆58Updated 6 months ago
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆108Updated this week
• sambanova / toolbench
  ToolBench, an evaluation suite for LLM tool manipulation capabilities.
  ☆151Updated last year
• Ber666 / RAP
  Reasoning with Language Model is Planning with World Model
  ☆165Updated last year
• LeapLabTHU / ExpeL
  ☆133Updated 4 months ago
• jwhj / OREO
  ☆110Updated 3 months ago
• kanishkg / cognitive-behaviors
  ☆165Updated last month
• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆135Updated 5 months ago
• salesforce / BOLAA
  ☆180Updated 3 months ago
• zjunlp / AutoAct
  [ACL 2024] AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planning
  ☆223Updated 4 months ago
• Open-Source-O1 / o1_Reasoning_Patterns_Study
  ☆102Updated 5 months ago
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆125Updated 10 months ago
• kohjingyu / search-agents
  Code for the paper 🌳 Tree Search for Language Model Agents
  ☆199Updated 9 months ago
• zankner / CLoud
  Critique-out-Loud Reward Models
  ☆64Updated 6 months ago
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples
  ☆85Updated last month
• InfiAgent / InfiAgent
  InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks (ICML 2024)
  ☆125Updated 4 months ago
• karthikv792 / LLMs-Planning
  An extensible benchmark for evaluating large language models on planning
  ☆361Updated 3 weeks ago