mazpie / genrl
[NeurIPS 2024] GenRL: Multimodal-foundation world models enable grounding language and video prompts into embodied domains, by turning them into sequences of latent world model states. Latent state sequences can be decoded using the decoder of the model, allowing visualization of the expected behavior, before training the agent to execute it.
☆78Updated last month
Alternatives and similar repositories for genrl
Users that are interested in genrl are comparing it to the libraries listed below
Sorting:
- Code for the ICLR 2024 spotlight paper: "Learning to Act without Actions" (introducing Latent Action Policies)☆100Updated 9 months ago
- PWM: Policy Learning with Large World Models☆46Updated 2 months ago
- [ECCV 2024] 💐Official implementation of the paper "Diffusion Reward: Learning Rewards via Conditional Video Diffusion"☆102Updated 10 months ago
- DrM, a visual RL algorithm, minimizes the dormant ratio to guide exploration-exploitation trade-offs, achieving significant improvements …☆74Updated 11 months ago
- Official code for "QueST: Self-Supervised Skill Abstractions for Continuous Control" [NeurIPS 2024]☆76Updated 5 months ago
- VP2 Benchmark (A Control-Centric Benchmark for Video Prediction, ICLR 2023)☆26Updated 2 months ago
- Using advances in generative modeling to learn reward functions from unlabeled videos.☆129Updated last year
- Public code for "Reinforcement Learning from Passive Data via Latent Intentions"☆89Updated last year
- Official repository for "LIV: Language-Image Representations and Rewards for Robotic Control" (ICML 2023)☆107Updated last year
- Code release for "Pre-training Contextualized World Models with In-the-wild Videos for Reinforcement Learning" (NeurIPS 2023), https://ar…☆62Updated 7 months ago
- ☆56Updated 2 years ago
- ☆17Updated 3 months ago
- ☆76Updated 8 months ago
- ☆53Updated 3 months ago
- ☆45Updated last year
- (ICLR 2024) Reverse Forward Curriculum Learning☆47Updated 5 months ago
- ☆66Updated 6 months ago
- ☆44Updated last year
- Code for "Masked Autoencoding for Scalable and Generalizable Decision Making". NeurIPS 2022☆44Updated last year
- dataloading is my passion☆51Updated last year
- Finetuning Offline World Models in the Real World☆57Updated last year
- ☆33Updated last month
- Streaming Diffusion Policy: Fast Policy Synthesis with Variable Noise Diffusion Models☆55Updated 7 months ago
- ☆40Updated last year
- Codebase for HiP☆89Updated last year
- Code for the paper "Policy Adaptation via Language Optimization: Decomposing Tasks for Few-Shot Imitation"☆29Updated 5 months ago
- [IJCAI'24] An index of algorithms, approaches, and systems on cross-domain policy transfer for embodied agents☆50Updated 3 months ago
- Unfied World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets☆64Updated 3 weeks ago
- Official repository for "VIP: Towards Universal Visual Reward and Representation via Value-Implicit Pre-Training"☆155Updated last year
- The official codebase for running the experiments described in the AVDC paper.☆17Updated 7 months ago