We release the UICaption dataset. The dataset consists of UI images (icons and screenshots) and associated text descriptions. This dataset was used to pre-train the Lexi model which provides a generic representation of UI screens and their components.
☆42Nov 29, 2022Updated 3 years ago
Alternatives and similar repositories for UICaption
Users that are interested in UICaption are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- VINS: Visual Search for Mobile User Interface Design☆51Jan 9, 2021Updated 5 years ago
- Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments☆61Aug 19, 2024Updated last year
- Code that accompanies the PyData New York (2022) talk: Addressing the sensitivity of Large language models☆13Nov 7, 2022Updated 3 years ago
- [NeurIPS 2022] code for "K-LITE: Learning Transferable Visual Models with External Knowledge" https://arxiv.org/abs/2204.09222☆53Jun 12, 2023Updated 2 years ago
- AI Manga Editor capable of text recognition, translation, inpainting and editing.☆23Mar 25, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [Arxiv2022] Revitalize Region Feature for Democratizing Video-Language Pre-training☆22Mar 19, 2022Updated 4 years ago
- Repository for the paper "Data Efficient Masked Language Modeling for Vision and Language".☆18Sep 17, 2021Updated 4 years ago
- ☆19Oct 3, 2023Updated 2 years ago
- The dataset includes UI object type labels (e.g., BUTTON, IMAGE, CHECKBOX) that describes the semantic type of an UI object on Android ap…☆54Jan 14, 2022Updated 4 years ago
- A Benchmark for Robust, Multi-evidence, Multi-answer Question Answering☆17Jan 7, 2023Updated 3 years ago
- 📖 UI/UX context detection engine☆12Jan 3, 2021Updated 5 years ago
- PyTorch implementation of DINO (Self-Distillation with No Labels) from scratch.☆21May 13, 2025Updated 11 months ago
- A Vietnamese handwriting recognition project☆16Feb 21, 2024Updated 2 years ago
- The Screen Annotation dataset consists of pairs of mobile screenshots and their annotations. The annotations are in text format, and desc…☆89Mar 7, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆46Apr 8, 2024Updated 2 years ago
- Code and utilities for creating a Vision-and-Language Navigation (VLN) simulator environment from a physical space.☆12Nov 10, 2020Updated 5 years ago
- The GitHub browserslist config☆33Nov 21, 2024Updated last year
- An implementation of various color transfer algorithms.☆27Apr 22, 2025Updated last year
- Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environments☆13Nov 29, 2021Updated 4 years ago
- This repository shows how to train a CNN model for detecting vehicles and other objects on streets☆16Nov 21, 2019Updated 6 years ago
- Matterport and Unreal Engine Extension for Omniverse Isaac Sim☆21May 9, 2024Updated last year
- Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)☆29Mar 1, 2024Updated 2 years ago
- In-IDE Code Search☆29Apr 29, 2022Updated 4 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆13Dec 15, 2025Updated 4 months ago
- A Fabric Modpack aims for both Performance and Quality Of Life☆15Jun 5, 2023Updated 2 years ago
- ☆22Feb 22, 2024Updated 2 years ago
- Version 3.0.0 Pytorch implementations of DQN, DDQN, DDPG, SAC, Discrete SAC. With more features :)☆12Feb 16, 2023Updated 3 years ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆11Jul 22, 2023Updated 2 years ago
- Test utilities for mobile (android & ios) Kotlin Multiplatform development☆11Feb 11, 2022Updated 4 years ago
- For protecting/preventing AI to mimic everyone's arts☆28Jan 25, 2026Updated 3 months ago
- ☆12Mar 1, 2022Updated 4 years ago
- Audio to Audio (Whisper+ChatGPT+Bark)☆11Apr 30, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Learn AI development without frameworks. How ChatGPT, RAG, and AI agents actually work through 10 progressive modules. Just Python, APIs…☆40Mar 8, 2026Updated last month
- Cross-Domain Imitation Learning via Optimal Transport☆25Jun 24, 2022Updated 3 years ago
- Online Handwritten Text Recognition (HTR) system implemented with PyTorch. Based on https://doi.org/10.1007/s10032-020-00350-4.☆22Apr 22, 2026Updated last week
- Official implementation of Generative Colorization of Structured Mobile Web Pages, WACV 2023.☆22Dec 7, 2023Updated 2 years ago
- An official code of Densely-packed Object Detection via Hard Negative-Aware Anchor Attention in WACV2022☆12Jan 6, 2022Updated 4 years ago
- An interactive demo based on Segment-Anything for stroke-based painting which enables human-like painting.☆35Apr 16, 2023Updated 3 years ago
- ☆10Apr 12, 2017Updated 9 years ago