Alternatives and similar repositories for LLM-Agent-Benchmark-List:

Users that are interested in LLM-Agent-Benchmark-List are comparing it to the libraries listed below

• rxlqn / awesome-llm-self-reflection
  augmented LLM with self reflection
  ☆116Updated last year
• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆162Updated 3 months ago
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆108Updated 2 weeks ago
• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆129Updated 3 months ago
• jwhj / OREO
  ☆102Updated 2 months ago
• zjunlp / WKM
  [NeurIPS 2024] Agent Planning with World Knowledge Model
  ☆117Updated 3 months ago
• SALT-NLP / DyLAN
  Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization
  ☆134Updated 10 months ago
• Yu-Fangxu / FoR
  Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples
  ☆76Updated 2 weeks ago
• YifeiZhou02 / ArCHer
  Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"
  ☆149Updated 11 months ago
• zorazrw / awesome-tool-llm
  ☆215Updated 7 months ago
• microsoft / simulated-trial-and-error
  ☆120Updated 9 months ago
• zankner / CLoud
  Critique-out-Loud Reward Models
  ☆53Updated 5 months ago
• hkust-nlp / AgentBoard
  An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]
  ☆289Updated 10 months ago
• zjunlp / AutoAct
  [ACL 2024] AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planning
  ☆214Updated 2 months ago
• Yifan-Song793 / ETO
  Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)
  ☆127Updated 4 months ago
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆117Updated 9 months ago
• Open-Source-O1 / o1_Reasoning_Patterns_Study
  ☆101Updated 3 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆103Updated 11 months ago
• thunlp / Optima
  Code for paper "Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System"
  ☆52Updated 4 months ago
• THUNLP-MT / StableToolBench
  A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.
  ☆135Updated 2 weeks ago
• zjunlp / MachineSoM
  [ACL 2024] Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View
  ☆113Updated 10 months ago
• agentification / RAFA_code
  ☆141Updated 10 months ago
• QwenLM / ProcessBench
  ☆143Updated 3 months ago
• kohjingyu / search-agents
  Code for the paper 🌳 Tree Search for Language Model Agents
  ☆185Updated 7 months ago
• ryoungj / ToolEmu
  [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
  ☆131Updated 11 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆83Updated 3 months ago
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆121Updated 8 months ago
• sambanova / toolbench
  ToolBench, an evaluation suite for LLM tool manipulation capabilities.
  ☆150Updated last year