We release the UICaption dataset. The dataset consists of UI images (icons and screenshots) and associated text descriptions. This dataset was used to pre-train the Lexi model which provides a generic representation of UI screens and their components.
☆42Nov 29, 2022Updated 3 years ago
Alternatives and similar repositories for UICaption
Users that are interested in UICaption are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official code for "Too Brittle To Touch: Comparing the Stability of Quantization and Distillation Towards Developing Lightweight Low-Reso…☆18Oct 9, 2025Updated last year
- ☆16Jun 12, 2023Updated 3 years ago
- The dataset includes UI object type labels (e.g., BUTTON, IMAGE, CHECKBOX) that describes the semantic type of an UI object on Android ap…☆54Jan 14, 2022Updated 4 years ago
- The Screen Annotation dataset consists of pairs of mobile screenshots and their annotations. The annotations are in text format, and desc…☆95Mar 7, 2024Updated 2 years ago
- Quality Metrics for evaluating the inter-cluster reliability of Multidimensional Projections☆27Apr 30, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆10Jul 21, 2023Updated 3 years ago
- ☆16Oct 1, 2020Updated 6 years ago
- Gallery for Industry AI demos☆17May 1, 2023Updated 3 years ago
- Code for the paper "LASER: LLM Agent with State-Space Exploration for Web Navigation"☆37Sep 26, 2023Updated 3 years ago
- ☆20Oct 3, 2023Updated 3 years ago
- ☆17May 14, 2024Updated 2 years ago
- Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research☆15Jul 13, 2020Updated 6 years ago
- Screen2Vec is a new self-supervised technique for generating more comprehensive semantic embeddings of GUI screens and components using t…☆86Feb 3, 2025Updated last year
- A Benchmark for Robust, Multi-evidence, Multi-answer Question Answering☆18Jan 7, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Repository for the paper "Data Efficient Masked Language Modeling for Vision and Language".☆18Sep 17, 2021Updated 5 years ago
- Azure Object Detection Accelerator. A repo for quickly and easily setting up a sample object detection project with training, labelling, …☆20May 23, 2023Updated 3 years ago
- ☆22Jun 7, 2023Updated 3 years ago
- AI Manga Editor capable of text recognition, translation, inpainting and editing.☆28Mar 25, 2025Updated last year
- A repository for managing workshop contents for learning Microsoft Azure's data analytics platform with a focus on Databricks SQL and Syn…☆20Jul 4, 2023Updated 3 years ago
- The GitHub browserslist config☆37Jun 8, 2026Updated 5 months ago
- ScreenQA dataset was introduced in the "ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots" paper. It contains ~86K …☆154Feb 7, 2025Updated last year
- Vision-Language Navigation with Random Environmental Mixup☆10Aug 3, 2021Updated 5 years ago
- useful text recognition algorithms, CRNN and SVTR text recognition☆30Feb 10, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆11Aug 7, 2024Updated 2 years ago
- ☆46Apr 8, 2024Updated 2 years ago
- Code and utilities for creating a Vision-and-Language Navigation (VLN) simulator environment from a physical space.☆12Nov 10, 2020Updated 6 years ago
- ONNX Runtime C++ sample code that can run in Linux☆10Oct 8, 2021Updated 5 years ago
- A Fabric Modpack aims for both Performance and Quality Of Life☆14Jun 5, 2023Updated 3 years ago
- [EMNLP2025 Findings] Beyond Surface Alignment: Rebuilding LLMs Safety Mechanism via Probabilistically Ablating Refusal Direction☆11Apr 9, 2026Updated 7 months ago
- B2 Quick Start Sample App using Python (boto3) and B2 S3 Compatible API. First in series. This sample app integrates with a pre-staged B…☆20Jan 20, 2026Updated 9 months ago
- ☆17Aug 10, 2024Updated 2 years ago
- In-IDE Code Search☆29Apr 29, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- With this repository we show you a way to use Podman to run a GPU container without root privileges.☆14Oct 4, 2020Updated 6 years ago
- An Automatic Prompt Optimization Framework for Large Language Models☆14Aug 1, 2025Updated last year
- ☆34Oct 1, 2024Updated 2 years ago
- A fast approach for translating a series of text prompts into a video. The 2022 NeurIPS Workshop on Machine Learning for Creativity and D…☆34Jul 5, 2023Updated 3 years ago
- Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)☆29Mar 1, 2024Updated 2 years ago
- ☆11Jun 30, 2025Updated last year
- ☆22Feb 22, 2024Updated 2 years ago
Are these results useful?