microsoft / LLF-BenchLinks
A benchmark for evaluating learning agents based on just language feedback
☆92Updated 6 months ago
Alternatives and similar repositories for LLF-Bench
Users that are interested in LLF-Bench are comparing it to the libraries listed below
Sorting:
- SmartPlay is a benchmark for Large Language Models (LLMs). Uses a variety of games to test various important LLM capabilities as agents. …☆144Updated last year
- ☆106Updated last year
- ☆86Updated last year
- Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models☆65Updated 9 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆147Updated last year
- ☆144Updated last year
- ScienceWorld is a text-based virtual environment centered around accomplishing tasks from the standardized elementary science curriculum.☆312Updated last week
- ☆221Updated 2 years ago
- ☆28Updated 9 months ago
- An OpenAI gym environment to evaluate the ability of LLMs (eg. GPT-4, Claude) in long-horizon reasoning and task planning in dynamic mult…☆72Updated 2 years ago
- Verlog: A Multi-turn RL framework for LLM agents☆66Updated 3 weeks ago
- ☆59Updated last year
- WONDERBREAD benchmark + dataset for BPM tasks☆31Updated 4 months ago
- Repository for the paper Stream of Search: Learning to Search in Language☆151Updated 10 months ago
- ☆65Updated 9 months ago
- AdaPlanner: Language Models for Decision Making via Adaptive Planning from Feedback☆122Updated 8 months ago
- [ICLR 2024] Trajectory-as-Exemplar Prompting with Memory for Computer Control☆62Updated 11 months ago
- augmented LLM with self reflection☆135Updated 2 years ago
- DialOp: Decision-oriented dialogue environments for collaborative language agents☆111Updated last year
- Code for paper Empowering Large Language Model Agents through Action Learning☆32Updated last year
- Official code for the paper "ADaPT: As-Needed Decomposition and Planning with Language Models"☆90Updated last year
- Official implementation of the DECKARD Agent from the paper "Do Embodied Agents Dream of Pixelated Sheep?"☆94Updated 2 years ago
- Reasoning with Language Model is Planning with World Model☆180Updated 2 years ago
- Benchmarking Agentic LLM and VLM Reasoning On Games☆207Updated last week
- ☆96Updated last year
- We develop world models that can be adapted with natural language. Intergrating these models into artificial agents allows humans to effe…☆25Updated last year
- Natural Language Reinforcement Learning☆100Updated 4 months ago
- Lamorel is a Python library designed for RL practitioners eager to use Large Language Models (LLMs).☆243Updated last month
- ☆117Updated 10 months ago
- Code for the paper 🌳 Tree Search for Language Model Agents☆216Updated last year