mazpie / genrlLinks
[NeurIPS 2024] GenRL: Multimodal-foundation world models enable grounding language and video prompts into embodied domains, by turning them into sequences of latent world model states. Latent state sequences can be decoded using the decoder of the model, allowing visualization of the expected behavior, before training the agent to execute it.
☆81Updated 6 months ago
Alternatives and similar repositories for genrl
Users that are interested in genrl are comparing it to the libraries listed below
Sorting:
- Using advances in generative modeling to learn reward functions from unlabeled videos.☆135Updated last year
- Code for the ICLR 2024 spotlight paper: "Learning to Act without Actions" (introducing Latent Action Policies)☆125Updated last year
- PWM: Policy Learning with Large World Models☆57Updated 2 months ago
- Official repository for "LIV: Language-Image Representations and Rewards for Robotic Control" (ICML 2023)☆121Updated last year
- DrM, a visual RL algorithm, minimizes the dormant ratio to guide exploration-exploitation trade-offs, achieving significant improvements …☆76Updated last year
- Chain-of-Thought Predictive Control☆58Updated 2 years ago
- Public code for "Reinforcement Learning from Passive Data via Latent Intentions"☆89Updated last year
- ☆60Updated 2 years ago
- ☆33Updated 3 months ago
- Official repository for "VIP: Towards Universal Visual Reward and Representation via Value-Implicit Pre-Training"☆171Updated last year
- From Play to Policy: Conditional Behavior Generation from Uncurated Robot Data☆55Updated 2 years ago
- Finetuning Offline World Models in the Real World☆62Updated last year
- ☆45Updated last year
- VP2 Benchmark (A Control-Centric Benchmark for Video Prediction, ICLR 2023)☆29Updated 7 months ago
- ☆27Updated last year
- official implementation for our paper Steering Your Generalists: Improving Robotic Foundation Models via Value Guidance (CoRL 2024)☆35Updated 5 months ago
- Code release for the paper "Goal Representations for Instruction Following: A Semi-Supervised Language Interface to Control"☆17Updated last year
- MiniGrid Implementation of BEHAVIOR Tasks☆53Updated 2 weeks ago
- Code for "Masked Autoencoding for Scalable and Generalizable Decision Making". NeurIPS 2022☆44Updated last year
- Masked World Models for Visual Control☆131Updated 2 years ago
- The official implementation of "Horizon Reduction Makes RL Scalable"☆140Updated 2 months ago
- [IJCAI'24] An index of algorithms, approaches, and systems on cross-domain policy transfer for embodied agents☆55Updated 7 months ago
- [ECCV 2024] 💐Official implementation of the paper "Diffusion Reward: Learning Rewards via Conditional Video Diffusion"☆112Updated last year
- JAX reimplementation of the DeepMind paper "Genie: Generative Interactive Environments"☆83Updated 8 months ago
- ☆62Updated last year
- ☆43Updated last year
- Voltron Evaluation: Diverse Evaluation Tasks for Robotic Representation Learning☆36Updated 2 years ago
- Official code for "QueST: Self-Supervised Skill Abstractions for Continuous Control" [NeurIPS 2024]☆103Updated 10 months ago
- NeurIPS 2022 Paper "VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation"☆96Updated 5 months ago
- Codebase for HiP☆90Updated last year