OpenGVLab / Instruct2ActLinks
Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model
☆368Updated last year
Alternatives and similar repositories for Instruct2Act
Users that are interested in Instruct2Act are comparing it to the libraries listed below
Sorting:
- Code for RoboFlamingo☆399Updated last year
- Implementation of "PaLM-E: An Embodied Multimodal Language Model"☆319Updated last year
- [arXiv 2023] Embodied Task Planning with Large Language Models☆189Updated 2 years ago
- Democratization of RT-2 "RT-2: New model translates vision and language into action"☆499Updated last year
- Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment: Robotic Learning Datasets and RT-X Models"☆221Updated this week
- Official Task Suite Implementation of ICML'23 Paper "VIMA: General Robot Manipulation with Multimodal Prompts"☆315Updated last year
- ☆386Updated 7 months ago
- Embodied Chain of Thought: A robotic policy that reason to solve the task.☆301Updated 4 months ago
- Generating Robotic Simulation Tasks via Large Language Models☆333Updated last year
- VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models☆723Updated 6 months ago
- [ICML 2024] 3D-VLA: A 3D Vision-Language-Action Generative World Model☆557Updated 10 months ago
- The official codebase for ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation(cvpr 2024)☆137Updated last year
- Code for "Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulation"☆274Updated last year
- Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success☆627Updated 4 months ago
- A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation☆320Updated 3 months ago
- 🔥 SpatialVLA: a spatial-enhanced vision-language-action model that is trained on 1.1 Million real robot episodes. Accepted at RSS 2025.☆460Updated 2 months ago
- [ICML 2024] Official code repository for 3D embodied generalist agent LEO☆456Updated 4 months ago
- [RSS 2025] Learning to Act Anywhere with Task-centric Latent Actions☆677Updated last week
- ☆206Updated last year
- DexGraspVLA: A Vision-Language-Action Framework Towards General Dexterous Grasping☆357Updated 2 weeks ago
- [CVPR 2025] RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concrete. Official Repository.☆299Updated 2 months ago
- Official Code for RVT-2 and RVT☆365Updated 6 months ago
- CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks☆656Updated last month
- Embodied Agent Interface (EAI): Benchmarking LLMs for Embodied Decision Making (NeurIPS D&B 2024 Oral)☆239Updated 5 months ago
- This repository compiles a list of papers related to the application of video technology in the field of robotics! Star⭐ the repo and fol…☆165Updated 7 months ago
- OpenHelix: An Open-source Dual-System VLA Model for Robotic Manipulation☆254Updated this week
- [CoRL 2023] This repository contains data generation and training code for Scaling Up & Distilling Down☆393Updated last year
- ☆198Updated 5 months ago
- Heterogeneous Pre-trained Transformer (HPT) as Scalable Policy Learner.☆510Updated 8 months ago
- [IROS24 Oral]ManipVQA: Injecting Robotic Affordance and Physically Grounded Information into Multi-Modal Large Language Models☆97Updated last year