OpenGVLab / Instruct2Act
Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model
☆362Updated 10 months ago
Alternatives and similar repositories for Instruct2Act
Users that are interested in Instruct2Act are comparing it to the libraries listed below
Sorting:
- Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment: Robotic Learning Datasets and RT-X Models"☆206Updated this week
- Code for RoboFlamingo☆376Updated last year
- Embodied Chain of Thought: A robotic policy that reason to solve the task.☆239Updated last month
- Official Task Suite Implementation of ICML'23 Paper "VIMA: General Robot Manipulation with Multimodal Prompts"☆299Updated last year
- [arXiv 2023] Embodied Task Planning with Large Language Models☆185Updated last year
- ☆344Updated 3 months ago
- [ICML 2024] Official code repository for 3D embodied generalist agent LEO☆437Updated 3 weeks ago
- Democratization of RT-2 "RT-2: New model translates vision and language into action"☆451Updated 9 months ago
- [ICML 2024] 3D-VLA: A 3D Vision-Language-Action Generative World Model☆503Updated 6 months ago
- Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success☆386Updated 2 weeks ago
- Evaluating and reproducing real-world robot manipulation policies (e.g., RT-1, RT-1-X, Octo) in simulation under common setups (e.g., Goo…☆609Updated last month
- Implementation of "PaLM-E: An Embodied Multimodal Language Model"☆302Updated last year
- Generating Robotic Simulation Tasks via Large Language Models☆325Updated last year
- The official codebase for ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation(cvpr 2024)☆131Updated 10 months ago
- A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation☆255Updated 2 weeks ago
- Paper list in the survey paper: Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis☆429Updated 3 months ago
- ☆135Updated last month
- Benchmarking Knowledge Transfer in Lifelong Robot Learning☆543Updated 2 months ago
- VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models☆683Updated 2 months ago
- Code for "Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulation"☆250Updated last year
- This repository compiles a list of papers related to the application of video technology in the field of robotics! Star⭐ the repo and fol…☆155Updated 3 months ago
- ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation☆755Updated 2 months ago
- DexGraspVLA: A Vision-Language-Action Framework Towards General Dexterous Grasping☆243Updated 2 weeks ago
- Official Code for RVT-2 and RVT☆337Updated 3 months ago
- [CoRL 2023] This repository contains data generation and training code for Scaling Up & Distilling Down☆390Updated 9 months ago
- 🔥 SpatialVLA: a spatial-enhanced vision-language-action model that is trained on 1.1 Million real robot episodes. Accepted at RSS 2025.☆301Updated 2 weeks ago
- "MimicPlay: Long-Horizon Imitation Learning by Watching Human Play" code repository☆268Updated last year
- CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks☆551Updated 3 months ago
- Code for the paper "3D Diffuser Actor: Policy Diffusion with 3D Scene Representations"☆305Updated 8 months ago
- [CVPR 2024 & NeurIPS 2024] EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AI☆591Updated 2 months ago