microsoft / LLF-Bench
A benchmark for evaluating learning agents based on just language feedback
☆69Updated 5 months ago
Alternatives and similar repositories for LLF-Bench:
Users that are interested in LLF-Bench are comparing it to the libraries listed below
- ☆81Updated 8 months ago
- SmartPlay is a benchmark for Large Language Models (LLMs). Uses a variety of games to test various important LLM capabilities as agents. …☆134Updated 11 months ago
- ☆81Updated last year
- Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models☆53Updated 3 weeks ago
- AdaPlanner: Language Models for Decision Making via Adaptive Planning from Feedback☆104Updated last year
- Repository for the paper Stream of Search: Learning to Search in Language☆140Updated last month
- Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples☆76Updated 2 weeks ago
- DialOp: Decision-oriented dialogue environments for collaborative language agents☆106Updated 4 months ago
- ☆102Updated last month
- ScienceWorld is a text-based virtual environment centered around accomplishing tasks from the standardized elementary science curriculum.☆245Updated 5 months ago
- Official code for the paper "ADaPT: As-Needed Decomposition and Planning with Language Models"☆74Updated last year
- The source code of the paper "Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Pla…☆85Updated 7 months ago
- ☆141Updated 10 months ago
- How to create rational LLM-based agents? Using game-theoretic workflows!☆58Updated last month
- An OpenAI gym environment to evaluate the ability of LLMs (eg. GPT-4, Claude) in long-horizon reasoning and task planning in dynamic mult…☆65Updated last year
- Dataset and benchmark for assessing LLMs in translating natural language descriptions of planning problems into PDDL☆48Updated 5 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆129Updated 3 months ago
- ☆215Updated last year
- ☆110Updated 3 weeks ago
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆52Updated 3 months ago
- ☆52Updated 2 weeks ago
- Reasoning with Language Model is Planning with World Model☆161Updated last year
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated last year
- Official implementation of the DECKARD Agent from the paper "Do Embodied Agents Dream of Pixelated Sheep?"☆91Updated last year
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 6 months ago
- Lamorel is a Python library designed for RL practitioners eager to use Large Language Models (LLMs).☆220Updated 4 months ago
- ☆95Updated 8 months ago
- Official Repo of LangSuitE☆82Updated 7 months ago
- Natural Language Reinforcement Learning☆78Updated 3 months ago