Alternatives and similar repositories for UIED

Users that are interested in UIED are comparing it to the libraries listed below

• chenjshnn / Object-Detection-for-Graphical-User-Interface
  Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?
  ☆127Updated last year
• MulongXie / GUI-Perceptual-Grouping
  Recognize graphic user interface layout through grouping GUI elements according to their visual attributes
  ☆42Updated 3 years ago
• js0nwu / webui
  ☆117Updated last year
• MulongXie / UI2CODE
  A tidied repo for UI2CODE, a reverse engineering system convert UI design to code automatically and precisely.
  ☆42Updated 4 years ago
• gridaco / ui-dataset
  A pre labelled dataset for ui element / layout detection
  ☆66Updated 2 years ago
• sbunian / VINS
  VINS: Visual Search for Mobile User Interface Design
  ☆41Updated 4 years ago
• kvyb / Segmentation-of-web-UI-elements-with-Detectron2
  Detectron2 Webserver (Faster-RCNN) implementation for Ubuntu 20.04. Real time object detection served over the internet.
  ☆33Updated 2 years ago
• luileito / enrico
  A curated mobile app design database
  ☆61Updated 3 years ago
• chenjshnn / LabelDroid
  Unblind Your Apps: Predicting Natural-Language Labels for Mobile GUI Components by Deep Learning
  ☆48Updated last year
• tobyli / Screen2Vec
  Screen2Vec is a new self-supervised technique for generating more comprehensive semantic embeddings of GUI screens and components using t…
  ☆73Updated 4 months ago
• kyegomez / ScreenAI
  Implementation of the ScreenAI model from the paper: "A Vision-Language Model for UI and Infographics Understanding"
  ☆348Updated 2 months ago
• datadrivendesign / semantic-icon-classifier
  ☆35Updated 2 years ago
• tezansahu / smart_ui_tf20
  App that generates a JSON file containing the details of various UI components from the screenshot of a wireframe. [Submission for Smart …
  ☆21Updated 4 years ago
• MobileLLM / DroidBot-GPT
  Automating Android apps with ChatGPT-like LLM.
  ☆128Updated last year
• MobileLLM / AutoDroid
  Source code for the paper "Empowering LLM to use Smartphone for Intelligent Task Automation"
  ☆364Updated last year
• zzxslp / MM-Navigator
  GPT-4V in Wonderland: LMMs as Smartphone Agents
  ☆133Updated 11 months ago
• google-research-datasets / screen_qa
  ScreenQA dataset was introduced in the "ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots" paper. It contains ~86K …
  ☆118Updated 4 months ago
• franklinbill / OwlEye
  Owl Eyes: Spotting UI Display Issues via Visual Understanding
  ☆17Updated 3 years ago
• soumikmohianuta / pixtoapp
  ☆36Updated 6 years ago
• kevalmorabia97 / CoVA-Web-Object-Detection
  A Context-aware Visual Attention-based training pipeline for Object Detection from a Webpage screenshot!
  ☆93Updated 4 months ago
• thomasdeanwhite / GUIdance
  Conv Net for identifying GUI componenets from screenshots using Tensorflow
  ☆12Updated 2 years ago
• njucckevin / SeeClick
  The model, data and code for the visual GUI Agent SeeClick
  ☆391Updated 7 months ago
• google-research-datasets / screen_annotation
  The Screen Annotation dataset consists of pairs of mobile screenshots and their annotations. The annotations are in text format, and desc…
  ☆72Updated last year
• google-research / pix2struct
  ☆650Updated 3 weeks ago
• cooelf / Auto-GUI
  Official implementation for "You Only Look at Screens: Multimodal Chain-of-Action Agents" (Findings of ACL 2024)
  ☆239Updated 11 months ago
• OSU-NLP-Group / Mind2Web
  [NeurIPS'23 Spotlight] "Mind2Web: Towards a Generalist Agent for the Web" -- the first LLM-based web agent and benchmark for generalist w…
  ☆836Updated 2 months ago
• deepneuralmachine / seq2act-tensorflow
  Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research
  ☆14Updated 4 years ago
• jin1ming / rico-json-processing
  JSON Processing of RICO Dataset
  ☆15Updated 2 years ago
• sidongfeng / AdaT
  ☆16Updated 2 years ago
• sidongfeng / gifdroid
  ☆10Updated 2 years ago