microsoft / UICaptionLinks
We release the UICaption dataset. The dataset consists of UI images (icons and screenshots) and associated text descriptions. This dataset was used to pre-train the Lexi model which provides a generic representation of UI screens and their components.
☆41Updated 2 years ago
Alternatives and similar repositories for UICaption
Users that are interested in UICaption are comparing it to the libraries listed below
Sorting:
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated 2 years ago
- ☆26Updated last year
- Submission to the inverse scaling prize☆23Updated 2 years ago
- An official codebase for paper " CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"☆52Updated 2 years ago
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆24Updated this week
- This is the official PyTorch repo for "UNIREX: A Unified Learning Framework for Language Model Rationale Extraction" (ICML 2022).☆26Updated 2 years ago
- [NeurIPS 2022] code for "K-LITE: Learning Transferable Visual Models with External Knowledge" https://arxiv.org/abs/2204.09222☆51Updated 2 years ago
- Tools for content datamining and NLP at scale☆44Updated last year
- Repository for the paper Do SSL Models Have Déjà Vu? A Case of Unintended Memorization in Self-supervised Learning☆36Updated 2 years ago
- ☆44Updated 11 months ago
- ☆24Updated 4 years ago
- Index of URLs to pdf files all over the internet and scripts☆24Updated 2 years ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆49Updated last year
- A Data Source for Reasoning Embodied Agents☆19Updated 2 years ago
- ☆26Updated last year
- Official code release for the paper Coder Reviewer Reranking for Code Generation.☆45Updated 2 years ago
- An Image/Text Retrieval Test Collection to Support Multimedia Content Creation☆20Updated last year
- code for paper "Accessing higher dimensions for unsupervised word translation"☆21Updated 2 years ago
- Parkar and Kim et al.'s paper on Can LLMs Select Important Instructions to Annotate?"☆12Updated last year
- ☆44Updated last year
- In-Context Alignment: Chat with Vanilla Language Models Before Fine-Tuning☆35Updated 2 years ago
- ☆87Updated last year
- Fault-aware neural code rankers☆29Updated 2 years ago
- SILO Language Models code repository☆83Updated last year
- Dataset introduced in PlotQA: Reasoning over Scientific Plots☆79Updated 2 years ago
- This repo contains data and code for the paper "Reasoning over Public and Private Data in Retrieval-Based Systems."☆46Updated last year
- ☆32Updated 4 years ago
- Official code for "Too Brittle To Touch: Comparing the Stability of Quantization and Distillation Towards Developing Lightweight Low-Reso…☆17Updated last week
- Repo for "Smart Word Suggestions" (SWS) task and benchmark☆20Updated last year
- Code and data from the paper 'Human Feedback is not Gold Standard'☆19Updated last year