microsoft / SmartPlayLinks
SmartPlay is a benchmark for Large Language Models (LLMs). Uses a variety of games to test various important LLM capabilities as agents. SmartPlay is designed to be easy to use, and to support future development of LLMs.
☆138Updated last year
Alternatives and similar repositories for SmartPlay
Users that are interested in SmartPlay are comparing it to the libraries listed below
Sorting:
- ☆95Updated 11 months ago
- ☆90Updated last year
- Official implementation of the DECKARD Agent from the paper "Do Embodied Agents Dream of Pixelated Sheep?"☆92Updated 2 years ago
- Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"☆179Updated 2 months ago
- ScienceWorld is a text-based virtual environment centered around accomplishing tasks from the standardized elementary science curriculum.☆270Updated last month
- Implementation of "Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agen…☆278Updated last year
- Lamorel is a Python library designed for RL practitioners eager to use Large Language Models (LLMs).☆234Updated 7 months ago
- ☆130Updated 11 months ago
- ☆61Updated 3 months ago
- AdaPlanner: Language Models for Decision Making via Adaptive Planning from Feedback☆108Updated 2 months ago
- Official Repo of LangSuitE☆84Updated 10 months ago
- We perform functional grounding of LLMs' knowledge in BabyAI-Text☆263Updated 10 months ago
- An OpenAI gym environment to evaluate the ability of LLMs (eg. GPT-4, Claude) in long-horizon reasoning and task planning in dynamic mult…☆69Updated 2 years ago
- CivRealm is an interactive environment for the open-source strategy game Freeciv-web based on Freeciv, a Civilization-inspired game.☆114Updated 9 months ago
- ☆114Updated 5 months ago
- ☆142Updated last year
- ☆44Updated last year
- [ICLR 2024 Spotlight] Code for the paper "Text2Reward: Reward Shaping with Language Models for Reinforcement Learning"☆166Updated 6 months ago
- [ICLR 2024] Trajectory-as-Exemplar Prompting with Memory for Computer Control☆57Updated 5 months ago
- ☆106Updated 2 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆138Updated 6 months ago
- Code for "Learning to Model the World with Language." ICML 2024 Oral.☆388Updated last year
- Implementation of "Open-World Multi-Task Control Through Goal-Aware Representation Learning and Adaptive Horizon Prediction"☆46Updated last year
- Natural Language Reinforcement Learning☆89Updated 6 months ago
- ☆218Updated 2 years ago
- A benchmark for evaluating learning agents based on just language feedback☆81Updated 2 weeks ago
- Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)☆144Updated 7 months ago
- [ICLR 2024] Source codes for the paper "Building Cooperative Embodied Agents Modularly with Large Language Models"☆259Updated 2 months ago
- This repo is a live list of papers on game playing and large multimodality model - "A Survey on Game Playing Agents and Large Models: Met…☆148Updated 9 months ago
- AAAI24(Oral) ProAgent: Building Proactive Cooperative Agents with Large Language Models☆83Updated 3 months ago