Alternatives and similar repositories for GTBench:

Users that are interested in GTBench are comparing it to the libraries listed below

• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆107Updated last month
• jiangjiechen / auction-arena
  Source code for our paper: "Put Your Money Where Your Mouth Is: Evaluating Strategic Planning and Execution of LLM Agents in an Auction A…
  ☆42Updated 11 months ago
• Yu-Fangxu / FoR
  Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples
  ☆57Updated this week
• sail-sg / oat
  🌾 OAT: Online AlignmenT for LLMs
  ☆81Updated 3 weeks ago
• cathyxl / MAgIC
  ☆37Updated 2 months ago
• jwhj / OREO
  ☆83Updated this week
• agentification / RAFA_code
  ☆140Updated 8 months ago
• waterhorse1 / Natural-language-RL
  Natural Language Reinforcement Learning
  ☆67Updated last month
• allenai / clin
  ☆81Updated last year
• architsharma97 / dpo-rlaif
  ☆93Updated 6 months ago
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆60Updated 7 months ago
• siyuyuan / evoagent
  Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"
  ☆77Updated 3 months ago
• thunlp / Optima
  Code for paper "Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System"
  ☆47Updated 2 months ago
• Yifan-Song793 / ETO
  Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)
  ☆109Updated 2 months ago
• rxlqn / awesome-llm-self-reflection
  augmented LLM with self reflection
  ☆109Updated last year
• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆134Updated last month
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆53Updated 10 months ago
• jonathanmli / Avalon-LLM
  This repository contains a LLM benchmark for the social deduction game `Resistance Avalon'
  ☆88Updated 4 months ago
• clinicalml / co-llm
  Co-LLM: Learning to Decode Collaboratively with Multiple Language Models
  ☆106Updated 8 months ago
• ltzheng / Synapse
  [ICLR 2024] Trajectory-as-Exemplar Prompting with Memory for Computer Control
  ☆54Updated last week
• haotiansun14 / AdaPlanner
  AdaPlanner: Language Models for Decision Making via Adaptive Planning from Feedback
  ☆100Updated last year
• sotopia-lab / sotopia-pi
  Sotopia-π: Interactive Learning of Socially Intelligent Language Agents (ACL 2024)
  ☆55Updated 8 months ago
• amazon-science / PAE
  ☆43Updated 2 weeks ago
• microsoft / SmartPlay
  SmartPlay is a benchmark for Large Language Models (LLMs). Uses a variety of games to test various important LLM capabilities as agents. …
  ☆126Updated 9 months ago
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆100Updated this week
• ScalerLab / JudgeBench
  ☆50Updated 2 months ago
• open-compass / Ada-LEval
  The official implementation of "Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks"
  ☆52Updated 8 months ago
• zitian-gao / SC-MCTS
  Interpretable Contrastive Monte Carlo Tree Search Reasoning
  ☆39Updated 2 months ago
• zjunlp / MachineSoM
  [ACL 2024] Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View
  ☆106Updated 8 months ago
• Wenyueh / game_theory
  How to create rational LLM-based agents? Using game-theoretic workflows!
  ☆46Updated last month