dongyh20 / Octopus
🐙Octopus, an embodied vision-language model trained with RLEF, emerging superior in embodied visual planning and programming.
☆249Updated 4 months ago
Related projects: ⓘ
- Open Platform for Embodied Agents☆241Updated last week
- [ICLR 2024] Source codes for the paper "Building Cooperative Embodied Agents Modularly with Large Language Models"☆209Updated 3 weeks ago
- Compose multimodal datasets 🎹☆170Updated 6 months ago
- OpenEQA Embodied Question Answering in the Era of Foundation Models☆202Updated last month
- (ECCV 2024) Code for V-IRL: Grounding Virtual Intelligence in Real Life☆301Updated 2 months ago
- Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model☆323Updated 2 months ago
- Long Context Transfer from Language to Vision☆293Updated 3 weeks ago
- [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents☆296Updated 5 months ago
- Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning☆176Updated this week
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation☆378Updated 5 months ago
- [ICML 2024] Official code repository for 3D embodied generalist agent LEO☆330Updated last month
- ☆37Updated 9 months ago
- Official repo for paper DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning.☆200Updated last month
- ControlLLM: Augment Language Models with Tools by Searching on Graphs☆184Updated 2 months ago
- Implementation of "PaLM-E: An Embodied Multimodal Language Model"☆249Updated 7 months ago
- [CVPR2024] This is the official implement of MP5☆72Updated 2 months ago
- Code for MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World☆115Updated 6 months ago
- [arXiv 2023] Embodied Task Planning with Large Language Models☆148Updated last year
- ☆145Updated 2 months ago
- Code for "Learning to Model the World with Language." ICML 2024 Oral.☆349Updated 11 months ago
- Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics,…☆107Updated last week
- Code and implementations for the paper "AgentGym: Evolving Large Language Model-based Agents across Diverse Environments" by Zhiheng Xi e…☆305Updated last week
- [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs☆112Updated 3 weeks ago
- This is the official code of VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding (ECCV 2024)☆101Updated last week
- ☆294Updated 3 months ago
- SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models☆113Updated this week
- ☆102Updated 2 months ago
- RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthiness☆200Updated last week
- This repository compiles a list of papers related to the application of video technology in the field of robotics! Star⭐ the repo and fol…☆114Updated last month
- Implementation of "Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agen…☆248Updated last year