Alternatives and similar repositories for CoAT:

Users that are interested in CoAT are comparing it to the libraries listed below

• OpenGVLab / GUI-Odyssey
  GUI Odyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUI Odyssey consists of 7,735 episodes fr…
  ☆89Updated 3 months ago
• RUCBM / GUICourse
  GUICourse: From General Vision Langauge Models to Versatile GUI Agents
  ☆99Updated 7 months ago
• YuxiangChai / AMEX-codebase
  ☆28Updated 4 months ago
• THUDM / VisualAgentBench
  Towards Large Multimodal Models as Visual Foundation Agents
  ☆182Updated 2 weeks ago
• njucckevin / SeeClick
  The model, data and code for the visual GUI Agent SeeClick
  ☆312Updated 2 months ago
• OS-Copilot / OS-Genesis
  Code and data for OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis
  ☆96Updated 3 weeks ago
• xbmxb / CoCo-Agent
  ☆31Updated 8 months ago
• njucckevin / MM-Self-Improve
  A Self-Training Framework for Vision-Language Reasoning
  ☆63Updated 3 weeks ago
• cooelf / Auto-GUI
  Official implementation for "You Only Look at Screens: Multimodal Chain-of-Action Agents" (Findings of ACL 2024)
  ☆219Updated 7 months ago
• MobileAgentBench / mobile-agent-bench
  ☆26Updated 4 months ago
• aialt / awesome-mobile-agents
  ✨✨Latest Papers and Datasets on Mobile and PC GUI Agent
  ☆103Updated 2 months ago
• THUDM / Android-Lab
  ☆188Updated 2 months ago
• OpenGVLab / MM-NIAH
  [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…
  ☆109Updated 2 months ago
• vyokky / LLM-Brained-GUI-Agents-Survey
  GitHub page for "Large Language Model-Brained GUI Agents: A Survey"
  ☆112Updated 2 weeks ago
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆86Updated last month
• LightChen233 / M3CoT
  ☆60Updated 8 months ago
• OFA-Sys / TouchStone
  Touchstone: Evaluating Vision-Language Models by Language Models
  ☆82Updated last year
• JoeYing1019 / UltraTool
  [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios
  ☆52Updated 10 months ago
• RupertLuo / VoCoT
  VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models
  ☆45Updated 7 months ago
• MingyuJ666 / Disentangling-Memory-and-Reasoning
  [preprint] We propose a novel fine-tuning method, Separate Memory and Reasoning, which combines prompt tuning with LoRA.
  ☆41Updated last month
• X-LANCE / Mobile-Env
  A Universal Platform for Training and Evaluation of Mobile Interaction
  ☆41Updated 2 months ago
• LightChen233 / reasoning-boundary
  ☆45Updated 4 months ago
• alipay / mobile-agent
  ☆37Updated 11 months ago
• InfiMM / Awesome-Multimodal-LLM-for-Math-STEM
  Paper collections of multi-modal LLM for Math/STEM/Code.
  ☆71Updated last week
• OSU-NLP-Group / GUI-Agents-Paper-List
  Building a comprehensive and handy list of papers for GUI agents
  ☆209Updated last month
• pkunlp-icler / PCA-EVAL
  [ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain
  ☆103Updated 11 months ago
• princeton-nlp / CharXiv
  [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
  ☆96Updated last month
• FudanNLPLAB / MouSi
  ☆73Updated 11 months ago
• mathllm / MATH-V
  MATH-Vision dataset and code to measure Multimodal Mathematical Reasoning capabilities.
  ☆85Updated 4 months ago