Alternatives and similar repositories for CoAT:

Users that are interested in CoAT are comparing it to the libraries listed below

• OpenGVLab / GUI-Odyssey
  GUI Odyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUI Odyssey consists of 7,735 episodes fr…
  ☆109Updated 5 months ago
• RUCBM / GUICourse
  GUICourse: From General Vision Langauge Models to Versatile GUI Agents
  ☆113Updated 9 months ago
• YuxiangChai / AMEX-codebase
  ☆29Updated 7 months ago
• lll6gg / UI-R1
  Code for "UI-R1: Enhancing Action Prediction of GUI Agents by Reinforcement Learning"
  ☆88Updated this week
• OS-Copilot / OS-Genesis
  Code and data for OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis
  ☆130Updated last month
• njucckevin / SeeClick
  The model, data and code for the visual GUI Agent SeeClick
  ☆365Updated 5 months ago
• njucckevin / MM-Self-Improve
  A Self-Training Framework for Vision-Language Reasoning
  ☆77Updated 3 months ago
• THUDM / VisualAgentBench
  Towards Large Multimodal Models as Visual Foundation Agents
  ☆209Updated last week
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆100Updated 2 months ago
• xbmxb / CoCo-Agent
  ☆34Updated 10 months ago
• aialt / awesome-mobile-agents
  ✨✨Latest Papers and Datasets on Mobile and PC GUI Agent
  ☆124Updated 5 months ago
• OpenRLHF / OpenRLHF-M
  An Easy-to-use, Scalable and High-performance RLHF Framework designed for Multimodal Models.
  ☆120Updated 3 weeks ago
• OpenGVLab / MM-NIAH
  [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…
  ☆116Updated 5 months ago
• vyokky / LLM-Brained-GUI-Agents-Survey
  GitHub page for "Large Language Model-Brained GUI Agents: A Survey"
  ☆149Updated last week
• LengSicong / MMR1
  MMR1: Advancing the Frontiers of Multimodal Reasoning
  ☆159Updated last month
• OpenGVLab / MMT-Bench
  ICML'2024 | MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI
  ☆109Updated 9 months ago
• OSU-NLP-Group / Online-Mind2Web
  An Illusion of Progress? Assessing the Current State of Web Agents
  ☆40Updated 2 weeks ago
• qiancheng0 / ToolRL
  ☆115Updated last week
• LightChen233 / M3CoT
  ☆73Updated 10 months ago
• OSU-NLP-Group / UGround
  [ICLR'25 Oral] UGround: Universal GUI Visual Grounding for GUI Agents
  ☆215Updated this week
• RLHF-V / RLHF-V
  [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback
  ☆276Updated 7 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆74Updated 3 months ago
• thunlp / Muffin
  ☆63Updated last year
• mayubo2333 / MMLongBench-Doc
  Official Repository of MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations
  ☆80Updated 9 months ago
• RupertLuo / VoCoT
  VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models
  ☆55Updated 9 months ago
• princeton-nlp / CharXiv
  [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
  ☆110Updated last week
• CCAI-Lab / Awesome-GUI-Agents
  A curated collection of resources, tools, and frameworks for developing GUI Agents.
  ☆37Updated 2 weeks ago
• THUDM / Android-Lab
  ☆214Updated 2 weeks ago
• MobileAgentBench / mobile-agent-bench
  ☆29Updated 7 months ago
• RAGEN-AI / VAGEN
  ☆111Updated this week