Screen2Vec is a new self-supervised technique for generating more comprehensive semantic embeddings of GUI screens and components using their textual content, visual design and layout patterns, and app meta-data.
☆81Feb 3, 2025Updated last year
Alternatives and similar repositories for Screen2Vec
Users that are interested in Screen2Vec are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Swire Dataset and Application Code☆17Jan 7, 2019Updated 7 years ago
- The dataset includes UI object type labels (e.g., BUTTON, IMAGE, CHECKBOX) that describes the semantic type of an UI object on Android ap…☆54Jan 14, 2022Updated 4 years ago
- Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research☆15Jul 13, 2020Updated 5 years ago
- Consists of ~500k human annotations on the RICO dataset identifying various icons based on their shapes and semantics, and associations b…☆34Jun 27, 2024Updated last year
- It includes two datasets that are used in the downstream tasks for evaluating UIBert: App Similar Element Retrieval data and Visual Item …☆47Aug 2, 2021Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆20Jul 15, 2023Updated 2 years ago
- Time-travel Testing☆106Jul 4, 2022Updated 3 years ago
- VINS: Visual Search for Mobile User Interface Design☆51Jan 9, 2021Updated 5 years ago
- Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments☆61Aug 19, 2024Updated last year
- A curated mobile app design database☆67Sep 27, 2021Updated 4 years ago
- Official implementation of the MM'21 paper "Constrained Graphic Layout Generation via Latent Optimization" (LayoutGAN++, CLG-LO, and Layo…☆139Jul 24, 2023Updated 2 years ago
- An accurate GUI element detection approach based on old-fashioned CV algorithms [Upgraded on 5/July/2021]☆538Nov 8, 2023Updated 2 years ago
- Here is the code of "Hierarchical Layout Blending with Recursive Optimal Correspondence".☆17Sep 26, 2022Updated 3 years ago
- ☆16Apr 9, 2021Updated 5 years ago
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- A framework for building programmable applications☆29Jan 26, 2023Updated 3 years ago
- Pytorch implementation of LayoutGMN.☆48Mar 31, 2022Updated 4 years ago
- Mobile App Analysis and Testing Literature☆105Apr 1, 2026Updated last week
- Layout Generation and Baseline implementations☆163Jul 10, 2022Updated 3 years ago
- PyTorch implementation of "LayoutTransformer: Layout Generation and Completion with Self-attention" to appear in ICCV 2021☆166Jan 25, 2022Updated 4 years ago
- ☆15Apr 29, 2025Updated 11 months ago
- ☆17Jul 2, 2018Updated 7 years ago
- Code repository accompanying the CHI 2021 Paper titled "Adapting User Interfaces with Model-based Reinforcement Learning"☆16Oct 18, 2021Updated 4 years ago
- Mapping natural language commands to web elements☆38Jul 26, 2022Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A reproducing for article LayoutGAN: Generating Graphic Layouts with Wireframe Discriminators.☆79Jun 18, 2019Updated 6 years ago
- A color plugin for Sketch☆16Apr 12, 2023Updated 2 years ago
- ☆131Dec 4, 2023Updated 2 years ago
- 🏃♂️ Natural language activity tracking with GPT-3☆13Jan 9, 2023Updated 3 years ago
- 📖 UI/UX context detection engine☆12Jan 3, 2021Updated 5 years ago
- 第15章 Kotlin 文件IO操作与多线程☆13Sep 15, 2017Updated 8 years ago
- A large-scale curated dataset of Visual.ly infographics with metadata and additional crowdsourced annotations for research applications i…☆34Feb 4, 2019Updated 7 years ago
- ☆12Jan 8, 2016Updated 10 years ago
- Mutation-guided mutation-based fuzz testing☆51Jul 13, 2024Updated last year
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- LLM-powered tool that enhances OpenAPI specifications by extracting machine-readable constraints from human-readable descriptions.☆14Nov 6, 2024Updated last year
- ☆37Jan 12, 2024Updated 2 years ago
- ☆11May 24, 2022Updated 3 years ago
- My assignments of CMU 16825 Learning for 3D Vision class☆10Apr 14, 2024Updated last year
- ☆10Dec 13, 2021Updated 4 years ago
- 96 benchmark datasets for external clustering validation with class-label matching score☆13Oct 4, 2023Updated 2 years ago
- Implementation of LayoutGAN https://arxiv.org/abs/1901.06767☆17May 12, 2019Updated 6 years ago