microsoft / SmartPlayLinks
SmartPlay is a benchmark for Large Language Models (LLMs). Uses a variety of games to test various important LLM capabilities as agents. SmartPlay is designed to be easy to use, and to support future development of LLMs.
☆144Updated last year
Alternatives and similar repositories for SmartPlay
Users that are interested in SmartPlay are comparing it to the libraries listed below
Sorting:
- Implementation of "Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agen…☆290Updated 2 years ago
- Lamorel is a Python library designed for RL practitioners eager to use Large Language Models (LLMs).☆242Updated last month
- ☆106Updated last year
- ScienceWorld is a text-based virtual environment centered around accomplishing tasks from the standardized elementary science curriculum.☆310Updated 4 months ago
- ☆144Updated last year
- Official implementation of the DECKARD Agent from the paper "Do Embodied Agents Dream of Pixelated Sheep?"☆94Updated 2 years ago
- We perform functional grounding of LLMs' knowledge in BabyAI-Text☆276Updated last month
- ☆221Updated 2 years ago
- ☆96Updated last year
- An OpenAI gym environment to evaluate the ability of LLMs (eg. GPT-4, Claude) in long-horizon reasoning and task planning in dynamic mult…☆72Updated 2 years ago
- Reasoning with Language Model is Planning with World Model☆180Updated 2 years ago
- Code for "Learning to Model the World with Language." ICML 2024 Oral.☆413Updated 2 years ago
- AdaPlanner: Language Models for Decision Making via Adaptive Planning from Feedback☆122Updated 8 months ago
- Verlog: A Multi-turn RL framework for LLM agents☆66Updated 2 weeks ago
- Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"☆198Updated 7 months ago
- ☆65Updated 9 months ago
- Code for Contrastive Preference Learning (CPL)☆176Updated last year
- ☆117Updated 7 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆147Updated last year
- Implementation of "Open-World Multi-Task Control Through Goal-Aware Representation Learning and Adaptive Horizon Prediction"☆46Updated 2 years ago
- The source code of the paper "Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Pla…☆105Updated last year
- AAAI24(Oral) ProAgent: Building Proactive Cooperative Agents with Large Language Models☆93Updated 9 months ago
- [NeurIPS '23 Spotlight] Thought Cloning: Learning to Think while Acting by Imitating Human Thinking☆269Updated last year
- A benchmark for evaluating learning agents based on just language feedback☆92Updated 5 months ago
- ☆108Updated 5 months ago
- ☆39Updated last year
- Benchmarking Agentic LLM and VLM Reasoning On Games☆207Updated this week
- [ICLR 2024] Source codes for the paper "Building Cooperative Embodied Agents Modularly with Large Language Models"☆286Updated 8 months ago
- An extensible benchmark for evaluating large language models on planning☆432Updated 2 months ago
- CivRealm is an interactive environment for the open-source strategy game Freeciv-web based on Freeciv, a Civilization-inspired game.☆130Updated last year