mazpie / genrlLinks
[NeurIPS 2024] GenRL: Multimodal-foundation world models enable grounding language and video prompts into embodied domains, by turning them into sequences of latent world model states. Latent state sequences can be decoded using the decoder of the model, allowing visualization of the expected behavior, before training the agent to execute it.
☆77Updated 2 months ago
Alternatives and similar repositories for genrl
Users that are interested in genrl are comparing it to the libraries listed below
Sorting:
- PWM: Policy Learning with Large World Models☆49Updated 3 months ago
- DrM, a visual RL algorithm, minimizes the dormant ratio to guide exploration-exploitation trade-offs, achieving significant improvements …☆74Updated last year
- Using advances in generative modeling to learn reward functions from unlabeled videos.☆130Updated last year
- Code for the ICLR 2024 spotlight paper: "Learning to Act without Actions" (introducing Latent Action Policies)☆105Updated 10 months ago
- Official repository for "LIV: Language-Image Representations and Rewards for Robotic Control" (ICML 2023)☆109Updated last year
- Official code for "QueST: Self-Supervised Skill Abstractions for Continuous Control" [NeurIPS 2024]☆77Updated 6 months ago
- ☆55Updated 11 months ago
- VP2 Benchmark (A Control-Centric Benchmark for Video Prediction, ICLR 2023)☆25Updated 3 months ago
- Interactive Post-Training for Vision-Language-Action Models☆42Updated last week
- Code release for "Pre-training Contextualized World Models with In-the-wild Videos for Reinforcement Learning" (NeurIPS 2023), https://ar…☆64Updated 8 months ago
- JAX reimplementation of the DeepMind paper "Genie: Generative Interactive Environments"☆66Updated 4 months ago
- ☆76Updated last week
- Public code for "Reinforcement Learning from Passive Data via Latent Intentions"☆89Updated last year
- Masked World Models for Visual Control☆123Updated last year
- Streaming Diffusion Policy: Fast Policy Synthesis with Variable Noise Diffusion Models☆59Updated 3 weeks ago
- ☆56Updated 2 years ago
- ☆45Updated last year
- [ECCV 2024] 💐Official implementation of the paper "Diffusion Reward: Learning Rewards via Conditional Video Diffusion"☆104Updated 11 months ago
- ☆41Updated last year
- Official repository for "VIP: Towards Universal Visual Reward and Representation via Value-Implicit Pre-Training"☆157Updated last year
- Codebase for HiP☆90Updated last year
- MiniGrid Implementation of BEHAVIOR Tasks☆45Updated 9 months ago
- Chain-of-Thought Predictive Control☆57Updated 2 years ago
- ☆44Updated last year
- Official PyTorch implementation of AdaFlow☆51Updated 6 months ago
- (ICLR 2024) Reverse Forward Curriculum Learning☆47Updated 6 months ago
- official implementation for our paper Steering Your Generalists: Improving Robotic Foundation Models via Value Guidance (CoRL 2024)☆23Updated last month
- NeurIPS 2022 Paper "VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation"☆91Updated 3 weeks ago
- Recall to Imagine, a model-based RL algorithm with superhuman memory. Oral (1.2%) @ ICLR 2024☆67Updated last year
- ☆17Updated 4 months ago