showlab / ShowUI
☆10Updated this week
Related projects ⓘ
Alternatives and complementary repositories for ShowUI
- 💻 A curated list of papers and resources for multi-modal Graphical User Interface (GUI) agents.☆200Updated this week
- A Universal Platform for Training and Evaluation of Mobile Interaction☆37Updated last week
- GUICourse: From General Vision Langauge Models to Versatile GUI Agents☆83Updated 4 months ago
- GUI Odyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUI Odyssey consists of 7,735 episodes fr…☆69Updated last week
- This is the official code of VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding (ECCV 2024)☆131Updated 2 months ago
- Towards Large Multimodal Models as Visual Foundation Agents☆122Updated last week
- ☆65Updated last year
- Official implementation of WebVLN: Vision-and-Language Navigation on Websites☆23Updated 10 months ago
- 🐙Octopus, an embodied vision-language model trained with RLEF, emerging superior in embodied visual planning and programming.☆264Updated 6 months ago
- [NIPS24W]This repo is the official implementation of "MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simulated…☆73Updated 4 months ago
- ☆61Updated last month
- The model, data and code for the visual GUI Agent SeeClick☆226Updated 2 months ago
- The Official Code Repository for GUI-World.☆41Updated 3 months ago
- MLLM-Tool: A Multimodal Large Language Model For Tool Agent Learning☆98Updated 6 months ago
- [ICLR 2024] Source codes for the paper "Building Cooperative Embodied Agents Modularly with Large Language Models"☆225Updated 3 weeks ago
- ☆58Updated 9 months ago
- ⛏💎 STEVE in Minecraft is for See and Think: Embodied Agent in Virtual Environment☆30Updated 10 months ago
- Official implementation for "Android in the Zoo: Chain-of-Action-Thought for GUI Agents" (Findings of EMNLP 2024)☆48Updated last month
- [CVPR'24 Highlight] The official code and data for paper "EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Lan…☆48Updated 3 weeks ago
- SceneGenAgent: Precise Industrial Scene Generation with Coding Agent☆11Updated 3 weeks ago
- ☆120Updated last month
- Official implementation for "You Only Look at Screens: Multimodal Chain-of-Action Agents" (Findings of ACL 2024)☆198Updated 4 months ago
- ☆40Updated 11 months ago
- ☆23Updated 7 months ago
- Official code for Paper "Mantis: Multi-Image Instruction Tuning" (TMLR2024)☆184Updated this week
- ☆11Updated 6 months ago
- Official Repo for UGround☆97Updated 2 weeks ago
- [CVPR2024] This is the official implement of MP5☆84Updated 4 months ago
- A repository accompanying the PARTNR benchmark for using Large Planning Models (LPMs) to solve Human-Robot Collaboration or Robot Instruc…☆67Updated 2 weeks ago
- ☆27Updated 5 months ago