microsoft / LLF-Bench
A benchmark for evaluating learning agents based on just language feedback
☆66Updated 4 months ago
Alternatives and similar repositories for LLF-Bench:
Users that are interested in LLF-Bench are comparing it to the libraries listed below
- ☆78Updated 7 months ago
- ScienceWorld is a text-based virtual environment centered around accomplishing tasks from the standardized elementary science curriculum.☆239Updated 3 months ago
- SmartPlay is a benchmark for Large Language Models (LLMs). Uses a variety of games to test various important LLM capabilities as agents. …☆129Updated 10 months ago
- ☆81Updated last year
- ☆141Updated 9 months ago
- Repository for the paper Stream of Search: Learning to Search in Language☆137Updated last week
- AdaPlanner: Language Models for Decision Making via Adaptive Planning from Feedback☆101Updated last year
- An OpenAI gym environment to evaluate the ability of LLMs (eg. GPT-4, Claude) in long-horizon reasoning and task planning in dynamic mult…☆64Updated last year
- DialOp: Decision-oriented dialogue environments for collaborative language agents☆105Updated 3 months ago
- How to create rational LLM-based agents? Using game-theoretic workflows!☆49Updated 2 months ago
- Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"☆81Updated 3 months ago
- ☆90Updated 3 weeks ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆160Updated this week
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆125Updated 2 months ago
- ☆116Updated 4 months ago
- Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples☆72Updated 3 weeks ago
- ☆106Updated 3 weeks ago
- The source code of the paper "Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Pla…☆82Updated 6 months ago
- Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models☆48Updated last week
- [NeurIPS 2024] Agent Planning with World Knowledge Model☆110Updated last month
- ☆95Updated 7 months ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated 11 months ago
- ☆83Updated 8 months ago
- Dataset and benchmark for assessing LLMs in translating natural language descriptions of planning problems into PDDL☆48Updated 4 months ago
- augmented LLM with self reflection☆111Updated last year
- Lamorel is a Python library designed for RL practitioners eager to use Large Language Models (LLMs).☆211Updated 3 months ago
- Official Repo of LangSuitE☆81Updated 6 months ago
- A repository for transformer critique learning and generation☆88Updated last year
- An extensible benchmark for evaluating large language models on planning☆321Updated 8 months ago
- An Analytical Evaluation Board of Multi-turn LLM Agents☆279Updated 8 months ago