microsoft / UICaption
We release the UICaption dataset. The dataset consists of UI images (icons and screenshots) and associated text descriptions. This dataset was used to pre-train the Lexi model which provides a generic representation of UI screens and their components.
☆38Updated 2 years ago
Alternatives and similar repositories for UICaption:
Users that are interested in UICaption are comparing it to the libraries listed below
- Official code for "Too Brittle To Touch: Comparing the Stability of Quantization and Distillation Towards Developing Lightweight Low-Reso…☆17Updated last year
- Tools for content datamining and NLP at scale☆43Updated 10 months ago
- code for paper "Accessing higher dimensions for unsupervised word translation"☆21Updated last year
- CyBERTron-LM is a project which collects some pre-trained Transformer-based models.☆12Updated last year
- This repository contains the opensource version of the datasets were used for different parts of training and testing of models that grou…☆32Updated 4 years ago
- Fault-aware neural code rankers☆28Updated 2 years ago
- DeFacto - Demonstrations and Feedback for improving factual consistency of text summarization☆30Updated 2 years ago
- Index of URLs to pdf files all over the internet and scripts☆23Updated last year
- ☆13Updated 3 months ago
- Official code release for the paper Coder Reviewer Reranking for Code Generation.☆43Updated 2 years ago
- ☆27Updated 2 months ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated last year
- ☆18Updated last month
- Repository for Skill Set Optimization☆12Updated 9 months ago
- Code repo for "Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding"☆26Updated 8 months ago
- Towards Semantics-Enhanced Pre-Training: Can Lexicon Definitions Help Learning Sentence Meanings? (AAAI 2021)☆9Updated 4 years ago
- [EACL 2023] CoTEVer: Chain of Thought Prompting Annotation Toolkit for Explanation Verification☆40Updated last year
- Diffusion-based markup-to-image generation☆81Updated 2 years ago
- Generating and validating natural-language explanations for the brain.☆51Updated 3 weeks ago
- ☆44Updated 10 months ago
- ☆44Updated 3 years ago
- Experiments for "Automatic Calibration and Error Correction for Large Language Models via Pareto Optimal Self-Supervision"☆13Updated last year
- The official repo of our research work "Interactive Editing for Text Summarization".☆22Updated last year
- ☆54Updated last year
- ☆20Updated 10 months ago
- A server powering LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.☆13Updated 2 years ago
- [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation☆47Updated last year
- Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073☆28Updated 9 months ago
- A Universal Platform for Training and Evaluation of Mobile Interaction☆44Updated 2 months ago
- This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…☆22Updated 3 weeks ago