dongyh20 / OctopusLinks
[ECCV2024] 🐙Octopus, an embodied vision-language model trained with RLEF, emerging superior in embodied visual planning and programming.
☆288Updated last year
Alternatives and similar repositories for Octopus
Users that are interested in Octopus are comparing it to the libraries listed below
Sorting:
- [ICLR 2024] Source codes for the paper "Building Cooperative Embodied Agents Modularly with Large Language Models"☆260Updated 2 months ago
- Open Platform for Embodied Agents☆318Updated 4 months ago
- OpenEQA Embodied Question Answering in the Era of Foundation Models☆283Updated 8 months ago
- Code for "Learning to Model the World with Language." ICML 2024 Oral.☆386Updated last year
- Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model☆365Updated 11 months ago
- ☆129Updated 10 months ago
- [arXiv 2023] Embodied Task Planning with Large Language Models☆185Updated last year
- [CVPR2024] This is the official implement of MP5☆102Updated 11 months ago
- Code for MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World☆128Updated 7 months ago
- [ICCV'23] LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models☆188Updated 2 months ago
- [NeurIPSw'24] This repo is the official implementation of "MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simu…☆89Updated 4 months ago
- Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Tasks☆120Updated last week
- (ECCV 2024) Code for V-IRL: Grounding Virtual Intelligence in Real Life☆350Updated 6 months ago
- [ICLR 2024 Spotlight] Code for the paper "Text2Reward: Reward Shaping with Language Models for Reinforcement Learning"☆162Updated 5 months ago
- [ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain☆104Updated last year
- Implementation of "Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agen…☆278Updated last year
- [ICML 2024] Official code repository for 3D embodied generalist agent LEO☆439Updated last month
- Towards Large Multimodal Models as Visual Foundation Agents☆216Updated last month
- Implementation of "PaLM-E: An Embodied Multimodal Language Model"☆305Updated last year
- Embodied Agent Interface (EAI): Benchmarking LLMs for Embodied Decision Making (NeurIPS D&B 2024 Oral)☆200Updated 3 months ago
- Official repo for paper DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning.☆358Updated 3 months ago
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation☆443Updated 6 months ago
- ☆102Updated last month
- ☆44Updated last year
- [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents☆314Updated last year
- Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning☆359Updated 5 months ago
- Official repo of EmbodiedBench, a comprehensive benchmark designed to evaluate MLLMs as embodied agents. (ICML 2025)☆125Updated last month
- ☆89Updated 11 months ago
- SmartPlay is a benchmark for Large Language Models (LLMs). Uses a variety of games to test various important LLM capabilities as agents. …☆137Updated last year
- This repository compiles a list of papers related to the application of video technology in the field of robotics! Star⭐ the repo and fol…☆159Updated 4 months ago