Alternatives and similar repositories for Auto-GUI:

Users that are interested in Auto-GUI are comparing it to the libraries listed below

• THUDM / VisualAgentBench
  Towards Large Multimodal Models as Visual Foundation Agents
  ☆204Updated 2 months ago
• njucckevin / SeeClick
  The model, data and code for the visual GUI Agent SeeClick
  ☆360Updated 5 months ago
• RUCBM / GUICourse
  GUICourse: From General Vision Langauge Models to Versatile GUI Agents
  ☆107Updated 9 months ago
• X-LANCE / Mobile-Env
  A Universal Platform for Training and Evaluation of Mobile Interaction
  ☆44Updated last month
• web-arena-x / visualwebarena
  VisualWebArena is a benchmark for multimodal agents.
  ☆333Updated 5 months ago
• OpenGVLab / GUI-Odyssey
  GUI Odyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUI Odyssey consists of 7,735 episodes fr…
  ☆104Updated 5 months ago
• hkust-nlp / AgentBoard
  An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]
  ☆307Updated 11 months ago
• IMNearth / CoAT
  Official implementation for "Android in the Zoo: Chain-of-Action-Thought for GUI Agents" (Findings of EMNLP 2024)
  ☆83Updated 6 months ago
• OSU-NLP-Group / GUI-Agents-Paper-List
  Building a comprehensive and handy list of papers for GUI agents
  ☆295Updated last month
• DigiRL-agent / digirl
  Official repo for paper DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning.
  ☆348Updated 2 months ago
• OSU-NLP-Group / UGround
  [ICLR'25 Oral] UGround: Universal GUI Visual Grounding for GUI Agents
  ☆205Updated 3 weeks ago
• google-research / android_world
  AndroidWorld is an environment and benchmark for autonomous agents
  ☆277Updated this week
• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆133Updated 4 months ago
• google-research-datasets / screen_qa
  ScreenQA dataset was introduced in the "ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots" paper. It contains ~86K …
  ☆113Updated 2 months ago
• zjunlp / AutoAct
  [ACL 2024] AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planning
  ☆221Updated 3 months ago
• microsoft / simulated-trial-and-error
  ☆121Updated 10 months ago
• anchen1011 / FireAct
  FireAct: Toward Language Agent Fine-tuning
  ☆275Updated last year
• princeton-nlp / WebShop
  [NeurIPS 2022] 🛒WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents
  ☆328Updated 7 months ago
• aburns4 / MoTIF
  Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments
  ☆60Updated 8 months ago
• OS-Copilot / OS-Genesis
  Code and data for OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis
  ☆126Updated 2 weeks ago
• zzxslp / MM-Navigator
  GPT-4V in Wonderland: LMMs as Smartphone Agents
  ☆134Updated 9 months ago
• THUDM / Android-Lab
  ☆212Updated 3 weeks ago
• vyokky / LLM-Brained-GUI-Agents-Survey
  GitHub page for "Large Language Model-Brained GUI Agents: A Survey"
  ☆144Updated 3 weeks ago
• Dongping-Chen / GUI-World
  (ICLR 2025) The Official Code Repository for GUI-World.
  ☆53Updated 4 months ago
• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆181Updated this week
• Ber666 / ToolkenGPT
  ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings - NeurIPS 2023 (oral)
  ☆262Updated last year
• aialt / awesome-mobile-agents
  ✨✨Latest Papers and Datasets on Mobile and PC GUI Agent
  ☆121Updated 4 months ago
• XueyangFeng / LLM-Agent-Paper-Digest
  papers related to LLM-agent that published on top conferences
  ☆314Updated last week
• LeapLabTHU / ExpeL
  ☆131Updated 4 months ago
• jun0wanan / awesome-large-multimodal-agents
  ☆422Updated 6 months ago