Alternatives and similar repositories for LLM-Agent-Benchmark-List:

Users that are interested in LLM-Agent-Benchmark-List are comparing it to the libraries listed below

• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆136Updated last month
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆112Updated 4 months ago
• Yifan-Song793 / ETO
  Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)
  ☆114Updated 2 months ago
• SALT-NLP / DyLAN
  Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization
  ☆126Updated 8 months ago
• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆111Updated 2 months ago
• jwhj / OREO
  ☆87Updated last week
• rxlqn / awesome-llm-self-reflection
  augmented LLM with self reflection
  ☆110Updated last year
• zorazrw / awesome-tool-llm
  ☆206Updated 5 months ago
• Yu-Fangxu / FoR
  Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples
  ☆58Updated last week
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆110Updated 7 months ago
• zjunlp / WKM
  [NeurIPS 2024] Agent Planning with World Knowledge Model
  ☆104Updated last month
• zankner / CLoud
  Critique-out-Loud Reward Models
  ☆48Updated 3 months ago
• YifeiZhou02 / ArCHer
  Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"
  ☆125Updated 9 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated 11 months ago
• hkust-nlp / AgentBoard
  An Analytical Evaluation Board of Multi-turn LLM Agents
  ☆272Updated 8 months ago
• NingMiao / SelfCheck
  Code for the paper <SelfCheck: Using LLMs to Zero-Shot Check Their Own Step-by-Step Reasoning>
  ☆48Updated last year
• SALT-NLP / demonstrated-feedback
  ☆116Updated 3 months ago
• kohjingyu / search-agents
  Code for the paper 🌳 Tree Search for Language Model Agents
  ☆167Updated 6 months ago
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆119Updated 6 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆208Updated 2 months ago
• QwenLM / ProcessBench
  ☆129Updated last month
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆157Updated 8 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆95Updated 10 months ago
• zjunlp / MachineSoM
  [ACL 2024] Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View
  ☆107Updated 8 months ago
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆103Updated this week
• tongyx361 / Awesome-LLM4Math
  Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…
  ☆105Updated 6 months ago
• WooooDyy / LLM-Reverse-Curriculum-RL
  Implementation of the ICML 2024 paper "Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning" pr…
  ☆87Updated 11 months ago
• microsoft / simulated-trial-and-error
  ☆120Updated 7 months ago
• NumberChiffre / mcts-llm
  ☆88Updated last month
• Ber666 / RAP
  Reasoning with Language Model is Planning with World Model
  ☆156Updated last year