The dataset includes screen summaries that describes Android app screenshot's functionalities. It is used for training and evaluation of the screen2words models (our paper accepted by UIST'21 will be linked soon).
☆67Jul 27, 2021Updated 5 years ago
Alternatives and similar repositories for screen2words
Users that are interested in screen2words are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Screen2Vec is a new self-supervised technique for generating more comprehensive semantic embeddings of GUI screens and components using t…☆86Feb 3, 2025Updated last year
- It includes two datasets that are used in the downstream tasks for evaluating UIBert: App Similar Element Retrieval data and Visual Item …☆48Aug 2, 2021Updated 5 years ago
- The Screen Annotation dataset consists of pairs of mobile screenshots and their annotations. The annotations are in text format, and desc…☆94Mar 7, 2024Updated 2 years ago
- This repository contains the opensource version of the datasets were used for different parts of training and testing of models that grou…☆36Aug 20, 2020Updated 6 years ago
- VINS: Visual Search for Mobile User Interface Design☆54Jan 9, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A curated mobile app design database☆75Sep 27, 2021Updated 4 years ago
- The dataset includes UI object type labels (e.g., BUTTON, IMAGE, CHECKBOX) that describes the semantic type of an UI object on Android ap…☆54Jan 14, 2022Updated 4 years ago
- ☆33Sep 27, 2024Updated last year
- [WWW2024 Oral] Harnessing Multi-Role Capabilities of Large Language Models for Open-Domain Question Answering☆15Apr 22, 2025Updated last year
- ☆132Dec 4, 2023Updated 2 years ago
- Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments☆61Aug 19, 2024Updated 2 years ago
- A mobile GUI search engine using a vision-language model☆15May 5, 2025Updated last year
- ScreenQA dataset was introduced in the "ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots" paper. It contains ~86K …☆152Feb 7, 2025Updated last year
- Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research☆15Jul 13, 2020Updated 6 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- The official repository of "SmartAgent: Chain-of-User-Thought for Embodied Personalized Agent in Cyber World".☆28Jul 27, 2026Updated last month
- A GAN-based GUI generation method☆79May 22, 2021Updated 5 years ago
- Owl Eyes: Spotting UI Display Issues via Visual Understanding☆22Nov 15, 2021Updated 4 years ago
- Implementation of the ScreenAI model from the paper: "A Vision-Language Model for UI and Infographics Understanding"☆388Aug 28, 2026Updated 3 weeks ago
- We release the UICaption dataset. The dataset consists of UI images (icons and screenshots) and associated text descriptions. This datase…☆42Nov 29, 2022Updated 3 years ago
- ☆36Jan 22, 2019Updated 7 years ago
- [ICML 2026] GUIEvalKit: Open-source Evaluation Toolkit for GUI Agents☆25Feb 26, 2026Updated 6 months ago
- The official GitHub page for ''What Makes for Good Visual Instructions? Synthesizing Complex Visual Reasoning Instructions for Visual Ins…☆19Nov 10, 2023Updated 2 years ago
- Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?☆128Feb 20, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆37May 29, 2025Updated last year
- Overview of Clone Detection Tools for Java☆14Aug 23, 2025Updated last year
- ☆30Apr 16, 2024Updated 2 years ago
- LINEBot☆13Apr 7, 2025Updated last year
- Consists of ~500k human annotations on the RICO dataset identifying various icons based on their shapes and semantics, and associations b…☆36Jun 27, 2024Updated 2 years ago
- (ICLR 2025) The Official Code Repository for GUI-World.☆70Aug 2, 2026Updated last month
- ☆10Feb 8, 2021Updated 5 years ago
- 📖 UI/UX context detection engine☆12Jan 3, 2021Updated 5 years ago
- ☆15Jan 19, 2020Updated 6 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A customized version of Ella used in the paper `An Empirical Study of Android Test Generation Tools in Industrial Cases`.☆10Aug 19, 2020Updated 6 years ago
- Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models☆36Sep 19, 2023Updated 3 years ago
- ☆16Apr 9, 2021Updated 5 years ago
- ☆10Aug 28, 2020Updated 6 years ago
- PyTorch reimplementation of "LayoutGAN: Generating Graphic Layouts with Wireframe Discriminators" publishsed in ICLR 2019☆19Sep 13, 2021Updated 5 years ago
- ☆15Apr 6, 2023Updated 3 years ago
- Quality Metrics for evaluating the inter-cluster reliability of Multidimensional Projections☆27Apr 30, 2023Updated 3 years ago