microsoft / SmartPlay
SmartPlay is a benchmark for Large Language Models (LLMs). Uses a variety of games to test various important LLM capabilities as agents. SmartPlay is designed to be easy to use, and to support future development of LLMs.
☆129Updated 10 months ago
Alternatives and similar repositories for SmartPlay:
Users that are interested in SmartPlay are comparing it to the libraries listed below
- Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"☆127Updated 10 months ago
- ☆78Updated 7 months ago
- ScienceWorld is a text-based virtual environment centered around accomplishing tasks from the standardized elementary science curriculum.☆239Updated 3 months ago
- AdaPlanner: Language Models for Decision Making via Adaptive Planning from Feedback☆101Updated last year
- Implementation of "Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agen…☆270Updated last year
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆125Updated 2 months ago
- An OpenAI gym environment to evaluate the ability of LLMs (eg. GPT-4, Claude) in long-horizon reasoning and task planning in dynamic mult…☆64Updated last year
- Official implementation of the DECKARD Agent from the paper "Do Embodied Agents Dream of Pixelated Sheep?"☆91Updated last year
- ☆83Updated 8 months ago
- ☆124Updated 7 months ago
- The source code of the paper "Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Pla…☆82Updated 6 months ago
- ☆45Updated this week
- ☆141Updated 9 months ago
- ☆212Updated last year
- Lamorel is a Python library designed for RL practitioners eager to use Large Language Models (LLMs).☆211Updated 3 months ago
- Official Repo of LangSuitE☆81Updated 6 months ago
- [ICLR 2024] Source codes for the paper "Building Cooperative Embodied Agents Modularly with Large Language Models"☆243Updated 3 months ago
- ☆44Updated last year
- ☆90Updated 3 weeks ago
- Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"☆120Updated 3 months ago
- GROOT: Learning to Follow Instructions by Watching Gameplay Videos☆61Updated last year
- Reasoning with Language Model is Planning with World Model☆157Updated last year
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision☆115Updated 5 months ago
- ☆106Updated 3 months ago
- An extensible benchmark for evaluating large language models on planning☆321Updated 8 months ago
- CivRealm is an interactive environment for the open-source strategy game Freeciv-web based on Freeciv, a Civilization-inspired game.☆102Updated 5 months ago
- [ICLR 2024 Spotlight] Code for the paper "Text2Reward: Reward Shaping with Language Models for Reinforcement Learning"☆146Updated last month
- Code for "Learning to Model the World with Language." ICML 2024 Oral.☆377Updated last year
- A benchmark for evaluating learning agents based on just language feedback☆66Updated 4 months ago
- SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks☆297Updated 3 months ago