IMNearth / CoAT
Official implementation for "Android in the Zoo: Chain-of-Action-Thought for GUI Agents" (Findings of EMNLP 2024)
☆82Updated 5 months ago
Alternatives and similar repositories for CoAT:
Users that are interested in CoAT are comparing it to the libraries listed below
- GUI Odyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUI Odyssey consists of 7,735 episodes fr…☆101Updated 5 months ago
- GUICourse: From General Vision Langauge Models to Versatile GUI Agents☆107Updated 8 months ago
- ☆28Updated 6 months ago
- The model, data and code for the visual GUI Agent SeeClick☆357Updated 4 months ago
- ☆69Updated this week
- Towards Large Multimodal Models as Visual Foundation Agents☆202Updated 2 months ago
- ✨✨Latest Papers and Datasets on Mobile and PC GUI Agent☆120Updated 4 months ago
- Code and data for OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis☆121Updated last week
- Official implementation for "You Only Look at Screens: Multimodal Chain-of-Action Agents" (Findings of ACL 2024)☆231Updated 8 months ago
- A Self-Training Framework for Vision-Language Reasoning☆73Updated 2 months ago
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆99Updated last month
- ☆210Updated 2 weeks ago
- GitHub page for "Large Language Model-Brained GUI Agents: A Survey"☆142Updated 2 weeks ago
- ☆32Updated 9 months ago
- A Universal Platform for Training and Evaluation of Mobile Interaction☆44Updated last month
- ☆69Updated 10 months ago
- (ICLR 2025) The Official Code Repository for GUI-World.☆53Updated 3 months ago
- ☆28Updated 6 months ago
- Building a comprehensive and handy list of papers for GUI agents☆282Updated last month
- [ICLR'25 Oral] UGround: Universal GUI Visual Grounding for GUI Agents☆201Updated 3 weeks ago
- Official repository of MMDU dataset☆87Updated 6 months ago
- Paper collections of multi-modal LLM for Math/STEM/Code.☆85Updated 2 weeks ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆114Updated 4 months ago
- MMR1: Advancing the Frontiers of Multimodal Reasoning☆151Updated 3 weeks ago
- ☆63Updated last year
- ☆28Updated last week
- VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models☆52Updated 9 months ago
- An Easy-to-use, Scalable and High-performance RLHF Framework designed for Multimodal Models.☆107Updated this week
- [NeurIPS 2024 D&B Track] GTA: A Benchmark for General Tool Agents☆84Updated 2 weeks ago
- Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".☆52Updated 4 months ago