mazpie / genrlLinks
[NeurIPS 2024] GenRL: Multimodal-foundation world models enable grounding language and video prompts into embodied domains, by turning them into sequences of latent world model states. Latent state sequences can be decoded using the decoder of the model, allowing visualization of the expected behavior, before training the agent to execute it.
☆86Updated 10 months ago
Alternatives and similar repositories for genrl
Users that are interested in genrl are comparing it to the libraries listed below
Sorting:
- Using advances in generative modeling to learn reward functions from unlabeled videos.☆140Updated last year
- Code for the ICLR 2024 spotlight paper: "Learning to Act without Actions" (introducing Latent Action Policies)☆134Updated last year
- PWM: Policy Learning with Large World Models☆65Updated 6 months ago
- DrM, a visual RL algorithm, minimizes the dormant ratio to guide exploration-exploitation trade-offs, achieving significant improvements …☆78Updated last year
- Public code for "Reinforcement Learning from Passive Data via Latent Intentions"☆89Updated 2 years ago
- Official repository for "LIV: Language-Image Representations and Rewards for Robotic Control" (ICML 2023)☆130Updated 2 years ago
- ☆60Updated 2 years ago
- ☆35Updated 8 months ago
- ☆83Updated last month
- VP2 Benchmark (A Control-Centric Benchmark for Video Prediction, ICLR 2023)☆30Updated 11 months ago
- ☆31Updated last year
- Masked World Models for Visual Control☆135Updated 2 years ago
- Finetuning Offline World Models in the Real World☆65Updated 2 years ago
- ☆67Updated last year
- [ECCV 2024] 💐Official implementation of the paper "Diffusion Reward: Learning Rewards via Conditional Video Diffusion"☆116Updated last year
- Chain-of-Thought Predictive Control☆57Updated 2 years ago
- [IJCAI'24] An index of algorithms, approaches, and systems on cross-domain policy transfer for embodied agents☆59Updated 11 months ago
- From Play to Policy: Conditional Behavior Generation from Uncurated Robot Data☆56Updated 2 years ago
- MiniGrid Implementation of BEHAVIOR Tasks☆58Updated 4 months ago
- Official repository for "VIP: Towards Universal Visual Reward and Representation via Value-Implicit Pre-Training"☆179Updated 2 years ago
- Recall to Imagine, a model-based RL algorithm with superhuman memory. Oral (1.2%) @ ICLR 2024☆78Updated last year
- Official code for "QueST: Self-Supervised Skill Abstractions for Continuous Control" [NeurIPS 2024]☆106Updated last year
- ☆46Updated 2 years ago
- Code release for the paper "Goal Representations for Instruction Following: A Semi-Supervised Language Interface to Control"☆17Updated last year
- Official PyTorch implementation of AdaFlow☆63Updated last year
- Streaming Diffusion Policy: Fast Policy Synthesis with Variable Noise Diffusion Models☆74Updated 8 months ago
- Code for NeurIPS 2023 paper "Active Vision Reinforcement Learning with Limited Visual Observability"☆54Updated last year
- ☆43Updated last year
- ☆84Updated 8 months ago
- Code release for "Pre-training Contextualized World Models with In-the-wild Videos for Reinforcement Learning" (NeurIPS 2023), https://ar…☆70Updated last year