OpenGVLab / Instruct2Act
Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model
☆359Updated 10 months ago
Alternatives and similar repositories for Instruct2Act:
Users that are interested in Instruct2Act are comparing it to the libraries listed below
- Official Task Suite Implementation of ICML'23 Paper "VIMA: General Robot Manipulation with Multimodal Prompts"☆298Updated last year
- [arXiv 2023] Embodied Task Planning with Large Language Models☆182Updated last year
- [ICML 2024] Official code repository for 3D embodied generalist agent LEO☆433Updated this week
- Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment: Robotic Learning Datasets and RT-X Models"☆203Updated 2 weeks ago
- Code for RoboFlamingo☆369Updated 11 months ago
- ☆332Updated 3 months ago
- Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success☆343Updated 3 weeks ago
- [ICML 2024] 3D-VLA: A 3D Vision-Language-Action Generative World Model☆479Updated 5 months ago
- Embodied Chain of Thought: A robotic policy that reason to solve the task.☆225Updated 2 weeks ago
- DexGraspVLA: A Vision-Language-Action Framework Towards General Dexterous Grasping☆209Updated 3 weeks ago
- The official codebase for ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation(cvpr 2024)☆129Updated 9 months ago
- A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation☆239Updated 2 months ago
- Code for "Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulation"☆245Updated last year
- Democratization of RT-2 "RT-2: New model translates vision and language into action"☆442Updated 8 months ago
- Generating Robotic Simulation Tasks via Large Language Models☆325Updated last year
- Implementation of "PaLM-E: An Embodied Multimodal Language Model"☆299Updated last year
- Official repo of VLABench, a large scale benchmark designed for fairly evaluating VLA, Embodied Agent, and VLMs.☆204Updated 2 weeks ago
- Paper list in the survey paper: Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis☆425Updated 3 months ago
- ☆81Updated last year
- Evaluating and reproducing real-world robot manipulation policies (e.g., RT-1, RT-1-X, Octo) in simulation under common setups (e.g., Goo…☆595Updated 3 weeks ago
- [CoRL 2023] This repository contains data generation and training code for Scaling Up & Distilling Down☆389Updated 8 months ago
- 🔥 SpatialVLA: a spatial-enhanced vision-language-action model that is trained on 1.1 Million real robot episodes.☆237Updated last month
- Benchmarking Knowledge Transfer in Lifelong Robot Learning☆510Updated last month
- Code for the paper "3D Diffuser Actor: Policy Diffusion with 3D Scene Representations"☆299Updated 8 months ago
- The official repo for "SpatialBot: Precise Spatial Understanding with Vision Language Models.☆243Updated 2 months ago
- The repo of paper `RoboMamba: Multimodal State Space Model for Efficient Robot Reasoning and Manipulation`☆112Updated 4 months ago
- Official Algorithm Implementation of ICML'23 Paper "VIMA: General Robot Manipulation with Multimodal Prompts"☆803Updated last year
- "MimicPlay: Long-Horizon Imitation Learning by Watching Human Play" code repository☆267Updated last year
- ☆227Updated 3 months ago
- Codebase for paper: RoCo: Dialectic Multi-Robot Collaboration with Large Language Models☆200Updated last year