We release the UICaption dataset. The dataset consists of UI images (icons and screenshots) and associated text descriptions. This dataset was used to pre-train the Lexi model which provides a generic representation of UI screens and their components.
☆42Nov 29, 2022Updated 3 years ago
Alternatives and similar repositories for UICaption
Users that are interested in UICaption are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MacTok is a research prototype for a one-time anonymous token scheme based on algebraic MACs.☆23Apr 22, 2026Updated 3 weeks ago
- Official code for "Too Brittle To Touch: Comparing the Stability of Quantization and Distillation Towards Developing Lightweight Low-Reso…☆18Oct 9, 2025Updated 7 months ago
- ☆16Jun 12, 2023Updated 2 years ago
- It includes two datasets that are used in the downstream tasks for evaluating UIBert: App Similar Element Retrieval data and Visual Item …☆48Aug 2, 2021Updated 4 years ago
- DeFacto - Demonstrations and Feedback for improving factual consistency of text summarization☆30Dec 19, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- VINS: Visual Search for Mobile User Interface Design☆51Jan 9, 2021Updated 5 years ago
- Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments☆61Aug 19, 2024Updated last year
- A self-supervised learning approach based on extremely large masking☆31Dec 19, 2022Updated 3 years ago
- MySQL Tools Service that provides MySQL Server data management capabilities.☆22Jun 11, 2024Updated last year
- ☆16Oct 1, 2020Updated 5 years ago
- Repository for the paper "Data Efficient Masked Language Modeling for Vision and Language".☆18Sep 17, 2021Updated 4 years ago
- Code for the paper "LASER: LLM Agent with State-Space Exploration for Web Navigation"☆35Sep 26, 2023Updated 2 years ago
- ☆19Oct 3, 2023Updated 2 years ago
- The dataset includes screen summaries that describes Android app screenshot's functionalities. It is used for training and evaluation of …☆67Jul 27, 2021Updated 4 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Azure Object Detection Accelerator. A repo for quickly and easily setting up a sample object detection project with training, labelling, …☆20May 23, 2023Updated 2 years ago
- ☆17May 14, 2024Updated 2 years ago
- ScreenQA dataset was introduced in the "ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots" paper. It contains ~86K …☆148Feb 7, 2025Updated last year
- Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research☆15Jul 13, 2020Updated 5 years ago
- A Benchmark for Robust, Multi-evidence, Multi-answer Question Answering☆17Jan 7, 2023Updated 3 years ago
- Fault-aware neural code rankers☆32Dec 9, 2022Updated 3 years ago
- ☆46Apr 8, 2024Updated 2 years ago
- Table2Vec: Neural Word and Entity Embeddings for Table Population and Retrieval☆24Oct 28, 2018Updated 7 years ago
- SeeSo(Eye-Tracking SDK) Sample vanillaJS script.☆14Oct 17, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆23Jun 7, 2023Updated 2 years ago
- A repository for managing workshop contents for learning Microsoft Azure's data analytics platform with a focus on Databricks SQL and Syn…☆21Jul 4, 2023Updated 2 years ago
- Offline-first, decentralized graph database of collaborative Web apps☆15May 12, 2017Updated 9 years ago
- The GitHub browserslist config☆33May 6, 2026Updated last week
- An implementation of various color transfer algorithms.☆28Apr 22, 2025Updated last year
- ☆13Aug 10, 2024Updated last year
- python c-module for siphash☆20May 10, 2026Updated last week
- Matterport and Unreal Engine Extension for Omniverse Isaac Sim☆21May 9, 2024Updated 2 years ago
- In-IDE Code Search☆29Apr 29, 2022Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆13Dec 15, 2025Updated 5 months ago
- Data-driven offline simulation for online reinforcement learning: benchmark and baselines☆31Jul 25, 2024Updated last year
- ☆22Feb 22, 2024Updated 2 years ago
- Screen2Vec is a new self-supervised technique for generating more comprehensive semantic embeddings of GUI screens and components using t…☆84Feb 3, 2025Updated last year
- QLoRA: Efficient Finetuning of Quantized LLMs☆11Jul 22, 2023Updated 2 years ago
- NetPassage allows you to expose a web service, such as Microsoft Bot running on your local machine or on the private network to the publi…☆15Jul 20, 2023Updated 2 years ago
- SylNet: An Adaptable End-to-End Syllable Count Estimator for Speech☆27May 25, 2023Updated 2 years ago