microsoft / UICaption
We release the UICaption dataset. The dataset consists of UI images (icons and screenshots) and associated text descriptions. This dataset was used to pre-train the Lexi model which provides a generic representation of UI screens and their components.
☆38Updated 2 years ago
Alternatives and similar repositories for UICaption:
Users that are interested in UICaption are comparing it to the libraries listed below
- DeFacto - Demonstrations and Feedback for improving factual consistency of text summarization☆29Updated 2 years ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated last year
- code for paper "Accessing higher dimensions for unsupervised word translation"☆21Updated last year
- CyBERTron-LM is a project which collects some pre-trained Transformer-based models.☆12Updated last year
- Parkar and Kim et al.'s paper on Can LLMs Select Important Instructions to Annotate?"☆12Updated 8 months ago
- ☆22Updated last year
- [NeurIPS 2022] code for "K-LITE: Learning Transferable Visual Models with External Knowledge" https://arxiv.org/abs/2204.09222☆51Updated last year
- Repository for Skill Set Optimization☆12Updated 8 months ago
- Index of URLs to pdf files all over the internet and scripts☆23Updated last year
- Official code for "Too Brittle To Touch: Comparing the Stability of Quantization and Distillation Towards Developing Lightweight Low-Reso…☆17Updated last year
- Code repo for "Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding"☆25Updated 8 months ago
- In-Context Alignment: Chat with Vanilla Language Models Before Fine-Tuning☆34Updated last year
- SILO Language Models code repository☆81Updated last year
- ☆14Updated last year
- Towards Semantics-Enhanced Pre-Training: Can Lexicon Definitions Help Learning Sentence Meanings? (AAAI 2021)☆9Updated 4 years ago
- This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…☆22Updated this week
- This repo contains data and code for the paper "Reasoning over Public and Private Data in Retrieval-Based Systems."☆46Updated 8 months ago
- Fault-aware neural code rankers☆28Updated 2 years ago
- Repo for "Smart Word Suggestions" (SWS) task and benchmark☆20Updated last year
- ☆17Updated 11 months ago
- Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073☆28Updated 8 months ago
- ☆40Updated 8 months ago
- The official repo of our research work "Interactive Editing for Text Summarization".☆22Updated last year
- ☆12Updated 7 months ago
- Can LLMs generate code-mixed sentences through zero-shot prompting?☆11Updated last year
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆23Updated 2 weeks ago
- Generating and validating natural-language explanations for the brain.☆50Updated this week
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆47Updated last year
- Github repo for Peifeng's internship project☆14Updated last year
- A curated list of the papers, repositories, tutorials, and anythings related to the large language models for tools☆67Updated last year