Alternatives and similar repositories for UIED

Users that are interested in UIED are comparing it to the libraries listed below

• chenjshnn / Object-Detection-for-Graphical-User-Interface
  Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?
  ☆127Updated last year
• MulongXie / GUI-Perceptual-Grouping
  Recognize graphic user interface layout through grouping GUI elements according to their visual attributes
  ☆42Updated 2 years ago
• sbunian / VINS
  VINS: Visual Search for Mobile User Interface Design
  ☆40Updated 4 years ago
• js0nwu / webui
  ☆116Updated last year
• MulongXie / UI2CODE
  A tidied repo for UI2CODE, a reverse engineering system convert UI design to code automatically and precisely.
  ☆42Updated 4 years ago
• google-research-datasets / rico_semantics
  Consists of ~500k human annotations on the RICO dataset identifying various icons based on their shapes and semantics, and associations b…
  ☆28Updated 11 months ago
• kvyb / Segmentation-of-web-UI-elements-with-Detectron2
  Detectron2 Webserver (Faster-RCNN) implementation for Ubuntu 20.04. Real time object detection served over the internet.
  ☆32Updated 2 years ago
• kyegomez / ScreenAI
  Implementation of the ScreenAI model from the paper: "A Vision-Language Model for UI and Infographics Understanding"
  ☆342Updated 2 months ago
• gridaco / ui-dataset
  A pre labelled dataset for ui element / layout detection
  ☆65Updated last year
• sidongfeng / MUD
  ☆13Updated last year
• soumikmohianuta / pixtoapp
  ☆36Updated 6 years ago
• google-research-datasets / uibert
  It includes two datasets that are used in the downstream tasks for evaluating UIBert: App Similar Element Retrieval data and Visual Item …
  ☆43Updated 3 years ago
• chenjshnn / LabelDroid
  Unblind Your Apps: Predicting Natural-Language Labels for Mobile GUI Components by Deep Learning
  ☆48Updated last year
• tobyli / Screen2Vec
  Screen2Vec is a new self-supervised technique for generating more comprehensive semantic embeddings of GUI screens and components using t…
  ☆72Updated 4 months ago
• tezansahu / smart_ui_tf20
  App that generates a JSON file containing the details of various UI components from the screenshot of a wireframe. [Submission for Smart …
  ☆20Updated 4 years ago
• njucckevin / SeeClick
  The model, data and code for the visual GUI Agent SeeClick
  ☆379Updated 6 months ago
• MobileLLM / AutoDroid
  Source code for the paper "Empowering LLM to use Smartphone for Intelligent Task Automation"
  ☆359Updated last year
• datadrivendesign / semantic-icon-classifier
  ☆35Updated 2 years ago
• luileito / enrico
  A curated mobile app design database
  ☆61Updated 3 years ago
• MobileLLM / DroidBot-GPT
  Automating Android apps with ChatGPT-like LLM.
  ☆128Updated last year
• jin1ming / rico-json-processing
  JSON Processing of RICO Dataset
  ☆15Updated 2 years ago
• google-research / pix2struct
  ☆644Updated this week
• OSU-NLP-Group / Mind2Web
  [NeurIPS'23 Spotlight] "Mind2Web: Towards a Generalist Agent for the Web" -- the first LLM-based web agent and benchmark for generalist w…
  ☆830Updated 2 months ago
• franklinbill / OwlEye
  Owl Eyes: Spotting UI Display Issues via Visual Understanding
  ☆17Updated 3 years ago
• zzxslp / MM-Navigator
  GPT-4V in Wonderland: LMMs as Smartphone Agents
  ☆134Updated 10 months ago
• likaixin2000 / ScreenSpot-Pro-GUI-Grounding
  GUI Grounding for Professional High-Resolution Computer Use
  ☆209Updated 2 weeks ago
• Farama-Foundation / miniwob-plusplus
  MiniWoB++: a web interaction benchmark for reinforcement learning
  ☆321Updated last month
• sidongfeng / gifdroid
  ☆10Updated 2 years ago
• thomasdeanwhite / GUIdance
  Conv Net for identifying GUI componenets from screenshots using Tensorflow
  ☆12Updated 2 years ago
• google-research-datasets / screen_qa
  ScreenQA dataset was introduced in the "ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots" paper. It contains ~86K …
  ☆117Updated 3 months ago