ygjin11 / r2-play
The official implementation of the paper "Read to Play (R2-Play): Decision Transformer with Multimodal Game Instruction".
☆32Updated 9 months ago
Related projects ⓘ
Alternatives and complementary repositories for r2-play
- How to create rational LLM-based agents? Using game-theoretic workflows!☆27Updated last week
- ☆40Updated 11 months ago
- Official implementation of the DECKARD Agent from the paper "Do Embodied Agents Dream of Pixelated Sheep?"☆86Updated last year
- Code for "Interactive Task Planning with Language Models"☆25Updated last year
- GROOT: Learning to Follow Instructions by Watching Gameplay Videos☆56Updated 11 months ago
- An OpenAI gym environment to evaluate the ability of LLMs (eg. GPT-4, Claude) in long-horizon reasoning and task planning in dynamic mult…☆62Updated last year
- [ICLR 2024] Trajectory-as-Exemplar Prompting with Memory for Computer Control☆51Updated 3 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆97Updated last month
- Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"☆75Updated last month
- SmartPlay is a benchmark for Large Language Models (LLMs). Uses a variety of games to test various important LLM capabilities as agents. …☆121Updated 7 months ago
- ☆57Updated 2 weeks ago
- ☆36Updated 4 months ago
- The source code of the paper "Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Pla…☆77Updated 3 months ago
- MCU: A Task-centric Framework for Open-ended Agent Evaluation in Minecraft☆16Updated last year
- ☆137Updated 6 months ago
- [ICLR 2024] Code for the paper "Text2Reward: Automated Dense Reward Function Generation for Reinforcement Learning"☆129Updated last month
- Benchmarking Mobile Device Control Agents across Diverse Configurations (ICLR 2024 workshop GenAI4DM spotlight presentation)☆26Updated 2 weeks ago
- Official Repo of LangSuitE☆78Updated 3 months ago
- Q-Probe: A Lightweight Approach to Reward Maximization for Language Models☆37Updated 5 months ago
- ☆74Updated 4 months ago
- Efficient World Models with Context-Aware Tokenization. ICML 2024☆84Updated 2 months ago
- We develop world models that can be adapted with natural language. Intergrating these models into artificial agents allows humans to effe…☆19Updated 9 months ago
- This code accompanies the paper "Leveraging Skills from Unlabeled Prior Data for Efficient Online Exploration."☆23Updated last month
- ☆76Updated 5 months ago
- Toy implementation of Strawberry☆27Updated 2 months ago
- [NeurIPS 2024] Official Implementation for Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Tasks☆25Updated this week
- ☆30Updated this week
- ☆22Updated 2 months ago
- A RL approach to enable cost-effective, intelligent interactions between a local agent and a remote LLM☆64Updated 3 months ago
- Towards Large Multimodal Models as Visual Foundation Agents☆123Updated last week