Alternatives and similar repositories for ScreenAI:

Users that are interested in ScreenAI are comparing it to the libraries listed below

• OSU-NLP-Group / SeeAct
  [ICML'24] SeeAct is a system for generalist web agents that autonomously carry out tasks on any given website, with a focus on large mult…
  ☆737Updated 2 months ago
• njucckevin / SeeClick
  The model, data and code for the visual GUI Agent SeeClick
  ☆360Updated 4 months ago
• google-research-datasets / screen_qa
  ScreenQA dataset was introduced in the "ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots" paper. It contains ~86K …
  ☆113Updated 2 months ago
• xlang-ai / aguvis
  Aguvis: Unified Pure Vision Agents for Autonomous GUI Interaction
  ☆278Updated last month
• OSU-NLP-Group / UGround
  [ICLR'25 Oral] UGround: Universal GUI Visual Grounding for GUI Agents
  ☆205Updated 3 weeks ago
• OS-Copilot / OS-Atlas
  OS-ATLAS: A Foundation Action Model For Generalist GUI Agents
  ☆320Updated 2 months ago
• niuzaisheng / ScreenAgent
  ScreenAgent: A Computer Control Agent Driven by Visual Language Large Model (IJCAI-24)
  ☆436Updated 4 months ago
• likaixin2000 / ScreenSpot-Pro-GUI-Grounding
  GUI Grounding for Professional High-Resolution Computer Use
  ☆177Updated 2 months ago
• OSU-NLP-Group / Mind2Web
  [NeurIPS'23 Spotlight] "Mind2Web: Towards a Generalist Agent for the Web"
  ☆816Updated 2 weeks ago
• showlab / Awesome-GUI-Agent
  💻 A curated list of papers and resources for multi-modal Graphical User Interface (GUI) agents.
  ☆623Updated last month
• js0nwu / webui
  ☆113Updated last year
• McGill-NLP / weblinx
  WebLINX is a benchmark for building web navigation agents with conversational capabilities
  ☆146Updated 2 months ago
• cooelf / Auto-GUI
  Official implementation for "You Only Look at Screens: Multimodal Chain-of-Action Agents" (Findings of ACL 2024)
  ☆232Updated 9 months ago
• web-arena-x / webarena
  Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"
  ☆970Updated 2 months ago
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆739Updated last year
• MinorJerry / WebVoyager
  Code for "WebVoyager: WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models"
  ☆728Updated last year
• ltzheng / agent-studio
  [ICLR 2025] A trinity of environments, tools, and benchmarks for general virtual agents
  ☆199Updated this week
• google-research-datasets / screen_annotation
  The Screen Annotation dataset consists of pairs of mobile screenshots and their annotations. The annotations are in text format, and desc…
  ☆69Updated last year
• agent-husky / Husky-v1
  Code for Husky, an open-source language agent that solves complex, multi-step reasoning tasks. Husky v1 addresses numerical, tabular and …
  ☆340Updated 10 months ago
• web-arena-x / visualwebarena
  VisualWebArena is a benchmark for multimodal agents.
  ☆333Updated 5 months ago
• camel-ai / crab
  🦀️ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
  ☆333Updated 4 months ago
• ranpox / awesome-computer-use
  This is a collection of resources for computer-use GUI agents, including videos, blogs, papers, and projects.
  ☆329Updated this week
• microsoft / WindowsAgentArena
  Windows Agent Arena (WAA) 🪟 is a scalable OS platform for testing and benchmarking of multi-modal AI agents.
  ☆661Updated last month
• metauto-ai / agent-as-a-judge
  🤠 Agent-as-a-Judge and DevAI dataset
  ☆399Updated 3 months ago
• THUDM / WebRL
  Building Open LLM Web Agents with Self-Evolving Online Curriculum RL
  ☆361Updated 2 weeks ago
• showlab / ShowUI
  [CVPR 2025] Open-source, End-to-end, Vision-Language-Action model for GUI Agent & Computer Use.
  ☆1,185Updated last month
• allenai / lumos
  Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"
  ☆463Updated last year
• zzxslp / MM-Navigator
  GPT-4V in Wonderland: LMMs as Smartphone Agents
  ☆134Updated 9 months ago
• google-research / android_world
  AndroidWorld is an environment and benchmark for autonomous agents
  ☆277Updated this week
• dyabel / AnyTool
  ☆295Updated last year