thuml / iVideoGPT
Official repo for "iVideoGPT: Interactive VideoGPTs are Scalable World Models", https://arxiv.org/abs/2405.15223
☆60Updated 2 weeks ago
Related projects: ⓘ
- ☆63Updated last month
- Code release for "Pre-training Contextualized World Models with In-the-wild Videos for Reinforcement Learning" (NeurIPS 2023), https://ar…☆53Updated 7 months ago
- Repository for "General Flow as Foundation Affordance for Scalable Robot Learning"☆31Updated 5 months ago
- The repo of paper `RoboMamba: Multimodal State Space Model for Efficient Robot Reasoning and Manipulation`☆43Updated 3 months ago
- VP2 Benchmark (A Control-Centric Benchmark for Video Prediction, ICLR 2023)☆24Updated 8 months ago
- [ICML 2024] The offical Implementation of "DecisionNCE: Embodied Multimodal Representations via Implicit Preference Learning"☆62Updated 2 weeks ago
- [CVPR'2024] "SkillDiffuser: Interpretable Hierarchical Planning via Skill Abstractions in Diffusion-Based Task Execution"☆36Updated 4 months ago
- [ECCV 2024] 💐Official implementation of the paper "Diffusion Reward: Learning Rewards via Conditional Video Diffusion"☆66Updated 2 months ago
- [RSS 2024] Learning Manipulation by Predicting Interaction☆78Updated last month
- Official repository for "LIV: Language-Image Representations and Rewards for Robotic Control" (ICML 2023)☆79Updated 11 months ago
- [RSS 2024] Code for "Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goals" for CALVIN experiments with pre…☆51Updated 2 months ago
- Official repository of Learning to Act from Actionless Videos through Dense Correspondences.☆159Updated 4 months ago
- Code for "Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulation"☆95Updated 4 months ago
- Codebase for HiP☆84Updated 9 months ago
- ☆41Updated 2 weeks ago
- ☆32Updated last week
- ☆63Updated 3 weeks ago
- Theia: Distilling Diverse Vision Foundation Models for Robot Learning☆141Updated 2 weeks ago
- ☆20Updated 3 months ago
- ManiCM: Real-time 3D Diffusion Policy via Consistency Model for Robotic Manipulation☆61Updated 2 months ago
- [ICRA2023] Grounding Language with Visual Affordances over Unstructured Data☆34Updated 10 months ago
- NeurIPS 2022 Paper "VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation"☆79Updated last year
- ☆34Updated 4 months ago
- Code for subgoal synthesis via image editing☆99Updated 10 months ago
- ☆23Updated 2 months ago
- The official codebase for ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation(cvpr 2024)☆69Updated 2 months ago
- ☆35Updated 2 weeks ago
- [CoRL 2023 Oral] GNFactor: Multi-Task Real Robot Learning with Generalizable Neural Feature Fields☆111Updated 8 months ago
- Code for MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World☆115Updated 6 months ago
- Pytorch implementation of "Genie: Generative Interactive Environments", Bruce et al. (2024).☆49Updated 3 weeks ago