Alternatives and similar repositories for LLM-Agent-Benchmark-List

Users that are interested in LLM-Agent-Benchmark-List are comparing it to the libraries listed below

• rxlqn / awesome-llm-self-reflection
  augmented LLM with self reflection
  ☆126Updated last year
• zorazrw / awesome-tool-llm
  ☆232Updated 10 months ago
• SALT-NLP / DyLAN
  Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization
  ☆148Updated last year
• hkust-nlp / AgentBoard
  An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]
  ☆326Updated last year
• QwenLM / ProcessBench
  Official repository for ACL 2025 paper "ProcessBench: Identifying Process Errors in Mathematical Reasoning"
  ☆158Updated last month
• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆138Updated 7 months ago
• R2E-Gym / R2E-Gym
  Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents
  ☆77Updated 2 weeks ago
• Yifan-Song793 / ETO
  Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)
  ☆144Updated 7 months ago
• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆215Updated last month
• zjunlp / WorfBench
  [ICLR 2025] Benchmarking Agentic Workflow Generation
  ☆97Updated 4 months ago
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆95Updated 2 weeks ago
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆109Updated this week
• zjunlp / WKM
  [NeurIPS 2024] Agent Planning with World Knowledge Model
  ☆141Updated 6 months ago
• jwhj / OREO
  ☆114Updated 5 months ago
• facebookresearch / sweet_rl
  Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks
  ☆219Updated last month
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆125Updated last year
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆121Updated 9 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆109Updated last year
• ganler / code-r1
  Reproducing R1 for Code with Reliable Rewards
  ☆221Updated last month
• THUNLP-MT / StableToolBench
  A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.
  ☆156Updated 2 months ago
• kanishkg / cognitive-behaviors
  ☆190Updated 2 months ago
• ulab-uiuc / MARBLE
  (ACL 2025 Main) Code for MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents https://www.arxiv.org/pdf/2503.019…
  ☆120Updated this week
• YifeiZhou02 / ArCHer
  Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"
  ☆179Updated 2 months ago
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆127Updated 11 months ago
• kohjingyu / search-agents
  Code for the paper 🌳 Tree Search for Language Model Agents
  ☆201Updated 11 months ago
• GAIR-NLP / ToRL
  ☆220Updated last month
• GAIR-NLP / AIME-Preview
  ☆68Updated 3 months ago
• jonathanmli / Avalon-LLM
  This repository contains a LLM benchmark for the social deduction game `Resistance Avalon'
  ☆118Updated 3 weeks ago
• zankner / CLoud
  Critique-out-Loud Reward Models
  ☆66Updated 8 months ago
• ryoungj / ToolEmu
  [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
  ☆145Updated last year