microsoft / SmartPlay
SmartPlay is a benchmark for Large Language Models (LLMs). Uses a variety of games to test various important LLM capabilities as agents. SmartPlay is designed to be easy to use, and to support future development of LLMs.
☆135Updated last year
Alternatives and similar repositories for SmartPlay:
Users that are interested in SmartPlay are comparing it to the libraries listed below
- Official implementation of the DECKARD Agent from the paper "Do Embodied Agents Dream of Pixelated Sheep?"☆91Updated last year
- ScienceWorld is a text-based virtual environment centered around accomplishing tasks from the standardized elementary science curriculum.☆253Updated 6 months ago
- AdaPlanner: Language Models for Decision Making via Adaptive Planning from Feedback☆106Updated 2 weeks ago
- Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"☆160Updated last year
- ☆87Updated 9 months ago
- ☆85Updated 10 months ago
- Implementation of "Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agen…☆273Updated last year
- Official Repo of LangSuitE☆83Updated 8 months ago
- ☆126Updated 9 months ago
- [ICLR 2024] Trajectory-as-Exemplar Prompting with Memory for Computer Control☆54Updated 3 months ago
- ☆92Updated last week
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆132Updated 4 months ago
- ☆142Updated 11 months ago
- A benchmark for evaluating learning agents based on just language feedback☆71Updated 3 weeks ago
- ☆55Updated last month
- Lamorel is a Python library designed for RL practitioners eager to use Large Language Models (LLMs).☆226Updated 5 months ago
- ☆105Updated 2 months ago
- [ICLR 2024] Source codes for the paper "Building Cooperative Embodied Agents Modularly with Large Language Models"☆252Updated 2 weeks ago
- Implementation of "Open-World Multi-Task Control Through Goal-Aware Representation Learning and Adaptive Horizon Prediction"☆46Updated last year
- The source code of the paper "Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Pla…☆93Updated 8 months ago
- Natural Language Reinforcement Learning☆84Updated 3 months ago
- Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"☆150Updated 5 months ago
- ☆44Updated last year
- DialOp: Decision-oriented dialogue environments for collaborative language agents☆106Updated 5 months ago
- Reasoning with Language Model is Planning with World Model☆163Updated last year
- ☆218Updated last year
- Code for "Learning to Model the World with Language." ICML 2024 Oral.☆382Updated last year
- GROOT: Learning to Follow Instructions by Watching Gameplay Videos (ICLR 2024 Spotlight)☆64Updated last year
- We perform functional grounding of LLMs' knowledge in BabyAI-Text☆254Updated 7 months ago
- Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)☆133Updated 5 months ago