Screen2Vec is a new self-supervised technique for generating more comprehensive semantic embeddings of GUI screens and components using their textual content, visual design and layout patterns, and app meta-data.
☆86Feb 3, 2025Updated last year
Alternatives and similar repositories for Screen2Vec
Users that are interested in Screen2Vec are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Consists of ~500k human annotations on the RICO dataset identifying various icons based on their shapes and semantics, and associations b…☆36Jun 27, 2024Updated 2 years ago
- The dataset includes UI object type labels (e.g., BUTTON, IMAGE, CHECKBOX) that describes the semantic type of an UI object on Android ap…☆54Jan 14, 2022Updated 4 years ago
- Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research☆15Jul 13, 2020Updated 6 years ago
- It includes two datasets that are used in the downstream tasks for evaluating UIBert: App Similar Element Retrieval data and Visual Item …☆48Aug 2, 2021Updated 5 years ago
- A curated mobile app design database☆77Sep 27, 2021Updated 5 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Explore Android apps like human.☆135Feb 18, 2023Updated 3 years ago
- VINS: Visual Search for Mobile User Interface Design☆54Jan 9, 2021Updated 5 years ago
- MATE Automated Android Testing Tool☆18Sep 12, 2024Updated 2 years ago
- LayoutGAN-Tensorflow☆58Sep 11, 2020Updated 6 years ago
- An accurate GUI element detection approach based on old-fashioned CV algorithms [Upgraded on 5/July/2021]☆556Nov 8, 2023Updated 3 years ago
- The dataset includes widget captions that describes UI element's functionalities. It is used for training and evaluation of the widget ca…☆23Jun 24, 2021Updated 5 years ago
- Code repository accompanying the CHI 2021 Paper titled "Adapting User Interfaces with Model-based Reinforcement Learning"☆17Oct 18, 2021Updated 5 years ago
- We release the UICaption dataset. The dataset consists of UI images (icons and screenshots) and associated text descriptions. This datase…☆42Nov 29, 2022Updated 3 years ago
- Supplement material for "Assessing Effects of Task and Data Distribution on the Effectiveness of Visual Encodings".☆14Mar 6, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆16Apr 9, 2021Updated 5 years ago
- (Reproduce) Palette-based Photo Recoloring☆18Jun 24, 2020Updated 6 years ago
- Here is the code of "Hierarchical Layout Blending with Recursive Optimal Correspondence".☆17Sep 26, 2022Updated 4 years ago
- Code associated with the project http://predimportance.mit.edu/☆13Aug 7, 2020Updated 6 years ago
- Pytorch Implementation of DSN (IJCAI 2021)☆10Jun 23, 2021Updated 5 years ago
- Black-box tool that uses Deep Reinforcement Learning to test and explore Android applications☆81Sep 28, 2023Updated 3 years ago
- [ECCV 2024 Oral] GazeXplain - Official PyTorch Implementation☆18Feb 24, 2025Updated last year
- TensorFlow implementation of the CNN-LSTM, Relation Network and text-only baselines for the paper "FigureQA: An Annotated Figure Dataset …☆35Feb 22, 2018Updated 8 years ago
- Code for the ECCV 2020 paper: `Look here! A learning based approach to redirect visual attention'☆13Aug 19, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆21Aug 2, 2019Updated 7 years ago
- ☆17Jul 2, 2018Updated 8 years ago
- Code for the paper "Harmonious Textual Layout Generation over Natural Images via Deep Aesthetics Learning" (TMM 2021)☆41Aug 3, 2022Updated 4 years ago
- A toolset for the automatic GUI testing of mobile Android Applications.☆32Dec 28, 2017Updated 8 years ago
- ☆17Oct 12, 2023Updated 3 years ago
- ☆12Jul 5, 2024Updated 2 years ago
- Mobile App Analysis and Testing Literature☆113Sep 28, 2026Updated last month
- ☆14May 25, 2021Updated 5 years ago
- This is the official repository for the paper "Modeling Human Gaze Behavior with Diffusion Models for Unified Scanpath Prediction". ICCV …☆30May 13, 2026Updated 6 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- 🎼 text-to-video system for music visualization☆57Feb 15, 2024Updated 2 years ago
- Mapping natural language commands to web elements☆41Jul 26, 2022Updated 4 years ago
- Automated E2E mobile testing involving intercommunication scenarios.☆11Feb 28, 2021Updated 5 years ago
- A reproducing for article LayoutGAN: Generating Graphic Layouts with Wireframe Discriminators.☆79Jun 18, 2019Updated 7 years ago
- Move your project in the the future.☆11Dec 25, 2015Updated 10 years ago
- 第15章 Kotlin 文件IO操作与多线程☆13Sep 15, 2017Updated 9 years ago
- Official implementation of ColorizeDiffusionXL☆12Apr 9, 2026Updated 7 months ago
Are these results useful?