Screen2Vec is a new self-supervised technique for generating more comprehensive semantic embeddings of GUI screens and components using their textual content, visual design and layout patterns, and app meta-data.
☆81Feb 3, 2025Updated last year
Alternatives and similar repositories for Screen2Vec
Users that are interested in Screen2Vec are comparing it to the libraries listed below
Sorting:
- Unblind Your Apps: Predicting Natural-Language Labels for Mobile GUI Components by Deep Learning☆48Nov 16, 2023Updated 2 years ago
- Swire Dataset and Application Code☆17Jan 7, 2019Updated 7 years ago
- It includes two datasets that are used in the downstream tasks for evaluating UIBert: App Similar Element Retrieval data and Visual Item …☆47Aug 2, 2021Updated 4 years ago
- ☆36Nov 22, 2022Updated 3 years ago
- This repository holds the data and code for the AndroR2 dataset of manually-reproduced bug reports for Android apps☆25Jun 11, 2021Updated 4 years ago
- Conv Net for identifying GUI componenets from screenshots using Tensorflow☆12Mar 24, 2023Updated 2 years ago
- Time-travel Testing☆106Jul 4, 2022Updated 3 years ago
- Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments☆61Aug 19, 2024Updated last year
- Differences and similarities between TVCG and VIS papers. Also, crowdsourced submission data for TVCG. Enter anonymous submission data at…☆26Feb 7, 2022Updated 4 years ago
- Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?☆129Feb 20, 2024Updated 2 years ago
- The Themis Benchmark for evaluating automated GUI testing☆158Jan 8, 2024Updated 2 years ago
- ☆16Apr 9, 2021Updated 4 years ago
- Covert the UI design image into the skeleton code with deep learning☆172Oct 2, 2018Updated 7 years ago
- Fine-tune copilot based on your codebase☆12Mar 26, 2024Updated last year
- Code for the ECCV 2020 paper: `Look here! A learning based approach to redirect visual attention'☆13Aug 19, 2020Updated 5 years ago
- ☆21Aug 2, 2019Updated 6 years ago
- MATE Automated Android Testing Tool☆19Sep 12, 2024Updated last year
- ☆12Jul 5, 2024Updated last year
- Mapping natural language commands to web elements☆38Jul 26, 2022Updated 3 years ago
- A reproducing for article LayoutGAN: Generating Graphic Layouts with Wireframe Discriminators.☆79Jun 18, 2019Updated 6 years ago
- ☆131Dec 4, 2023Updated 2 years ago
- Documentation for a creative AI-powered proxy agent, aka a digital twin.☆14Nov 6, 2025Updated 4 months ago
- Implementation of CanvasVAE: Learning to Generate Vector Graphic Documents, ICCV 2021☆70Mar 7, 2023Updated 3 years ago
- ☆16May 14, 2024Updated last year
- ☆57Feb 2, 2021Updated 5 years ago
- Pytorch Implementation of Value Retrieval with Arbitrary Queries for Form-like Documents.☆16May 1, 2025Updated 10 months ago
- An environment for mobile angets to interact with realistic android device or android emulator☆13Jul 19, 2024Updated last year
- Notes for Database Principles Course☆14May 25, 2018Updated 7 years ago
- 第15章 Kotlin 文件IO操作与多线程☆13Sep 15, 2017Updated 8 years ago
- ☆12Feb 2, 2024Updated 2 years ago
- ☆10Dec 21, 2020Updated 5 years ago
- Owl Eyes: Spotting UI Display Issues via Visual Understanding☆22Nov 15, 2021Updated 4 years ago
- Mutation-guided mutation-based fuzz testing☆51Jul 13, 2024Updated last year
- LLM-powered tool that enhances OpenAPI specifications by extracting machine-readable constraints from human-readable descriptions.☆14Nov 6, 2024Updated last year
- PatchBackdoor is a code base associated with paper PatchBackdoor.☆12Aug 27, 2024Updated last year
- Palette-based Photo Recoloring, implementation of the approach of Huiwen Chang et al.☆53Mar 13, 2018Updated 8 years ago
- An app runing on Android to assistance DroidBot.☆22Sep 21, 2023Updated 2 years ago
- Neural Network package written in Java☆11Nov 2, 2020Updated 5 years ago
- 96 benchmark datasets for external clustering validation with class-label matching score☆13Oct 4, 2023Updated 2 years ago