Alternatives and similar repositories for LLM-Agent-Benchmark-List:

Users that are interested in LLM-Agent-Benchmark-List are comparing it to the libraries listed below

• zjunlp / WKM
  [NeurIPS 2024] Agent Planning with World Knowledge Model
  ☆110Updated last month
• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆125Updated 2 months ago
• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆141Updated 2 months ago
• rxlqn / awesome-llm-self-reflection
  augmented LLM with self reflection
  ☆111Updated last year
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆97Updated 10 months ago
• SuperBruceJia / Awesome-LLM-Self-Consistency
  Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models
  ☆86Updated 6 months ago
• Yu-Fangxu / FoR
  Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples
  ☆72Updated 3 weeks ago
• Yifan-Song793 / ETO
  Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)
  ☆116Updated 3 months ago
• zorazrw / awesome-tool-llm
  ☆209Updated 6 months ago
• jwhj / OREO
  ☆90Updated 3 weeks ago
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆115Updated 5 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆82Updated 2 months ago
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆112Updated 8 months ago
• hkust-nlp / AgentBoard
  An Analytical Evaluation Board of Multi-turn LLM Agents
  ☆279Updated 8 months ago
• PRIME-RL / ImplicitPRM
  Repo of paper "Free Process Rewards without Process Labels"
  ☆118Updated 3 weeks ago
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆103Updated this week
• ryoungj / ToolEmu
  [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
  ☆127Updated 10 months ago
• NumberChiffre / mcts-llm
  ☆89Updated 2 months ago
• NingMiao / SelfCheck
  Code for the paper <SelfCheck: Using LLMs to Zero-Shot Check Their Own Step-by-Step Reasoning>
  ☆48Updated last year
• zankner / CLoud
  Critique-out-Loud Reward Models
  ☆51Updated 3 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated 11 months ago
• QwenLM / ProcessBench
  ☆129Updated last month
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆119Updated 7 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆215Updated 3 months ago
• YuxiXie / SelfEval-Guided-Decoding
  ☆93Updated last year
• ZitongYang / Synthetic_Continued_Pretraining
  Code implementation of synthetic continued pretraining
  ☆87Updated last month
• architsharma97 / dpo-rlaif
  ☆95Updated 7 months ago
• thunlp / Optima
  Code for paper "Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System"
  ☆52Updated 3 months ago
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆77Updated 6 months ago