Alternatives and similar repositories for widget-caption

Users that are interested in widget-caption are comparing it to the libraries listed below

• google-research-datasets / screen2words
  The dataset includes screen summaries that describes Android app screenshot's functionalities. It is used for training and evaluation of …
  ☆57Updated 3 years ago
• google-research-datasets / rico_semantics
  Consists of ~500k human annotations on the RICO dataset identifying various icons based on their shapes and semantics, and associations b…
  ☆28Updated 11 months ago
• aburns4 / MoTIF
  Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments
  ☆60Updated 9 months ago
• google-research-datasets / screen_qa
  ScreenQA dataset was introduced in the "ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots" paper. It contains ~86K …
  ☆117Updated 3 months ago
• google-research-datasets / seq2act
  This repository contains the opensource version of the datasets were used for different parts of training and testing of models that grou…
  ☆32Updated 4 years ago
• js0nwu / webui
  ☆116Updated last year
• google-research-datasets / screen_annotation
  The Screen Annotation dataset consists of pairs of mobile screenshots and their annotations. The annotations are in text format, and desc…
  ☆71Updated last year
• google-research-datasets / clay
  The dataset includes UI object type labels (e.g., BUTTON, IMAGE, CHECKBOX) that describes the semantic type of an UI object on Android ap…
  ☆52Updated 3 years ago
• MulongXie / GUI-Perceptual-Grouping
  Recognize graphic user interface layout through grouping GUI elements according to their visual attributes
  ☆42Updated 2 years ago
• RUCBM / GUICourse
  GUICourse: From General Vision Langauge Models to Versatile GUI Agents
  ☆116Updated 10 months ago
• IMNearth / CoAT
  Official implementation for "Android in the Zoo: Chain-of-Action-Thought for GUI Agents" (Findings of EMNLP 2024)
  ☆86Updated 7 months ago
• cooelf / Auto-GUI
  Official implementation for "You Only Look at Screens: Multimodal Chain-of-Action Agents" (Findings of ACL 2024)
  ☆238Updated 10 months ago
• google-research-datasets / uibert
  It includes two datasets that are used in the downstream tasks for evaluating UIBert: App Similar Element Retrieval data and Visual Item …
  ☆43Updated 3 years ago
• nttmdlab-nlp / SlideVQA
  SlideVQA: A Dataset for Document Visual Question Answering on Multiple Images (AAAI2023)
  ☆90Updated 2 months ago
• vis-nlp / UniChart
  ☆72Updated 9 months ago
• chenjshnn / Object-Detection-for-Graphical-User-Interface
  Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?
  ☆127Updated last year
• luileito / enrico
  A curated mobile app design database
  ☆61Updated 3 years ago
• OpenGVLab / GUI-Odyssey
  GUI Odyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUI Odyssey consists of 7,735 episodes fr…
  ☆114Updated 6 months ago
• datadrivendesign / semantic-icon-classifier
  ☆35Updated 2 years ago
• njucckevin / SeeClick
  The model, data and code for the visual GUI Agent SeeClick
  ☆379Updated 6 months ago
• NiteshMethani / PlotQA
  Dataset introduced in PlotQA: Reasoning over Scientific Plots
  ☆77Updated last year
• vis-nlp / Chart-to-text
  ☆114Updated 10 months ago
• alipay / mobile-agent
  ☆41Updated last year
• LukeForeverYoung / UReader
  ☆135Updated last year
• X-LANCE / Mobile-Env
  A Universal Platform for Training and Evaluation of Mobile Interaction
  ☆45Updated 3 months ago
• sidongfeng / MUD
  ☆13Updated last year
• chuyg1005 / seeclick-crawler
  ☆18Updated last year
• SALT-NLP / LLaVAR
  Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"
  ☆267Updated 11 months ago
• potamides / DaTikZ
  ☆17Updated 2 months ago
• microsoft / ToolTalk
  Evaluating tool-augmented LLMs in conversation settings
  ☆84Updated last year