Alternatives and similar repositories for rico_semantics

Users that are interested in rico_semantics are comparing it to the libraries listed below

• sidongfeng / MUD
  ☆13Updated last year
• IMNearth / CoAT
  Official implementation for "Android in the Zoo: Chain-of-Action-Thought for GUI Agents" (Findings of EMNLP 2024)
  ☆90Updated 10 months ago
• OpenGVLab / GUI-Odyssey
  [ICCV 2025] GUIOdyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUIOdyssey consists of 8,834 e…
  ☆128Updated 3 weeks ago
• RUCBM / GUICourse
  GUICourse: From General Vision Langauge Models to Versatile GUI Agents
  ☆127Updated last year
• aburns4 / MoTIF
  Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments
  ☆61Updated last year
• njucckevin / SeeClick
  The model, data and code for the visual GUI Agent SeeClick
  ☆417Updated last month
• google-research-datasets / clay
  The dataset includes UI object type labels (e.g., BUTTON, IMAGE, CHECKBOX) that describes the semantic type of an UI object on Android ap…
  ☆52Updated 3 years ago
• google-research-datasets / screen_qa
  ScreenQA dataset was introduced in the "ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots" paper. It contains ~86K …
  ☆126Updated 6 months ago
• google-research-datasets / screen2words
  The dataset includes screen summaries that describes Android app screenshot's functionalities. It is used for training and evaluation of …
  ☆58Updated 4 years ago
• zzxslp / MM-Navigator
  GPT-4V in Wonderland: LMMs as Smartphone Agents
  ☆134Updated last year
• X-LANCE / META-GUI-baseline
  [EMNLP 2022] The baseline code for META-GUI dataset
  ☆14Updated last year
• sbunian / VINS
  VINS: Visual Search for Mobile User Interface Design
  ☆44Updated 4 years ago
• xbmxb / CoCo-Agent
  ☆36Updated last year
• cooelf / Auto-GUI
  Official implementation for "You Only Look at Screens: Multimodal Chain-of-Action Agents" (Findings of ACL 2024)
  ☆247Updated last year
• X-LANCE / Mobile-Env
  A Universal Platform for Training and Evaluation of Mobile Interaction
  ☆52Updated last month
• google-research-datasets / seq2act
  This repository contains the opensource version of the datasets were used for different parts of training and testing of models that grou…
  ☆32Updated 5 years ago
• MulongXie / GUI-Perceptual-Grouping
  Recognize graphic user interface layout through grouping GUI elements according to their visual attributes
  ☆45Updated 3 years ago
• google-research-datasets / screen_annotation
  The Screen Annotation dataset consists of pairs of mobile screenshots and their annotations. The annotations are in text format, and desc…
  ☆73Updated last year
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆346Updated 7 months ago
• YuxiangChai / AMEX-codebase
  ☆31Updated 11 months ago
• pipilurj / G-LLaVA
  Official github repo of G-LLaVA
  ☆146Updated 6 months ago
• vis-nlp / UniChart
  ☆80Updated last year
• Dongping-Chen / GUI-World
  (ICLR 2025) The Official Code Repository for GUI-World.
  ☆65Updated 8 months ago
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆307Updated 7 months ago
• SALT-NLP / LLaVAR
  Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"
  ☆269Updated last year
• ZJU-ACES-ISE / ChatUITest
  Under construction
  ☆11Updated 7 months ago
• OSU-NLP-Group / UGround
  [ICLR'25 Oral] UGround: Universal GUI Visual Grounding for GUI Agents
  ☆272Updated last month
• MBZUAI-LLM / web2code
  Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  ☆89Updated 10 months ago
• aburns4 / textualforesight
  ☆11Updated last year
• InfiXAI / InfiGUI-R1
  Repository for the paper "InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasoners"
  ☆59Updated 3 months ago