We release the UICaption dataset. The dataset consists of UI images (icons and screenshots) and associated text descriptions. This dataset was used to pre-train the Lexi model which provides a generic representation of UI screens and their components.
☆42Nov 29, 2022Updated 3 years ago
Alternatives and similar repositories for UICaption
Users that are interested in UICaption are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MacTok is a research prototype for a one-time anonymous token scheme based on algebraic MACs.☆23Apr 22, 2026Updated 2 months ago
- ☆132Dec 4, 2023Updated 2 years ago
- DeFacto - Demonstrations and Feedback for improving factual consistency of text summarization☆30Dec 19, 2022Updated 3 years ago
- VINS: Visual Search for Mobile User Interface Design☆53Jan 9, 2021Updated 5 years ago
- Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments☆61Aug 19, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A self-supervised learning approach based on extremely large masking☆31Dec 19, 2022Updated 3 years ago
- [NeurIPS 2022] code for "K-LITE: Learning Transferable Visual Models with External Knowledge" https://arxiv.org/abs/2204.09222☆54Jun 12, 2023Updated 3 years ago
- Code that accompanies the PyData New York (2022) talk: Addressing the sensitivity of Large language models☆13Nov 7, 2022Updated 3 years ago
- A fork of adoptium/aqa-tests with Msft specific changes☆12Jun 29, 2026Updated 3 weeks ago
- MySQL Tools Service that provides MySQL Server data management capabilities.☆22Jun 11, 2024Updated 2 years ago
- Quality Metrics for evaluating the inter-cluster reliability of Multidimensional Projections☆27Apr 30, 2023Updated 3 years ago
- The dataset includes UI object type labels (e.g., BUTTON, IMAGE, CHECKBOX) that describes the semantic type of an UI object on Android ap…☆54Jan 14, 2022Updated 4 years ago
- Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research☆15Jul 13, 2020Updated 6 years ago
- PANENE: Progressive Approximate NEarest NEighbors☆20Feb 12, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆23Jun 7, 2023Updated 3 years ago
- ☆46Apr 8, 2024Updated 2 years ago
- A simple voice conversion tool☆20Mar 10, 2022Updated 4 years ago
- The GitHub browserslist config☆36Jun 8, 2026Updated last month
- 📖 UI/UX context detection engine☆12Jan 3, 2021Updated 5 years ago
- Workflow-Guided Exploration: sample-efficient RL agent for web tasks☆118Jun 5, 2023Updated 3 years ago
- An implementation of various color transfer algorithms.☆29May 31, 2026Updated last month
- A collection of papers I am interested in.☆29Apr 3, 2023Updated 3 years ago
- Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)☆29Mar 1, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆22Feb 22, 2024Updated 2 years ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆11Jul 22, 2023Updated 2 years ago
- ☆12Mar 1, 2022Updated 4 years ago
- Cross-Domain Imitation Learning via Optimal Transport☆27Jun 24, 2022Updated 4 years ago
- A JavaScript toolkit for Natural Language-based Visualization Authoring☆37Oct 7, 2023Updated 2 years ago
- An interactive demo based on Segment-Anything for stroke-based painting which enables human-like painting.☆35Apr 16, 2023Updated 3 years ago
- Version 3.0.0 Pytorch implementations of DQN, DDQN, DDPG, SAC, Discrete SAC. With more features :)☆12Feb 16, 2023Updated 3 years ago
- An Opinionated Beginner Friendly Guide for Optimizing Python Coding Experience in Visual Studio Code. Check it out here: https://py-vscod…☆10Oct 25, 2019Updated 6 years ago
- Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073☆32Jul 9, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This is a collection of resources on AI-AR-ART generation.☆28Dec 14, 2022Updated 3 years ago
- Validate best practices in your project using this tool☆12May 9, 2019Updated 7 years ago
- UniTAB: Unifying Text and Box Outputs for Grounded VL Modeling, ECCV 2022 (Oral Presentation)☆90Jun 12, 2023Updated 3 years ago
- Terraform Script for - Storage, container and data life cycle rules creation at scale☆11Jan 10, 2023Updated 3 years ago
- TripleNet: Triple Attention Network for Multi-Turn Response Selection in Retrieval-based Chatbots (CoNLL2019)☆26Nov 18, 2019Updated 6 years ago
- Codespaces template for teaching .NET☆14Feb 28, 2024Updated 2 years ago
- Code for "Open Vocabulary Extreme Classification Using Generative Models"☆24Aug 25, 2022Updated 3 years ago