microsoft / UICaptionLinks
We release the UICaption dataset. The dataset consists of UI images (icons and screenshots) and associated text descriptions. This dataset was used to pre-train the Lexi model which provides a generic representation of UI screens and their components.
☆41Updated 3 years ago
Alternatives and similar repositories for UICaption
Users that are interested in UICaption are comparing it to the libraries listed below
Sorting:
- This is the official PyTorch repo for "UNIREX: A Unified Learning Framework for Language Model Rationale Extraction" (ICML 2022).☆26Updated 2 years ago
- Implementation of VisionLLaMA from the paper: "VisionLLaMA: A Unified LLaMA Interface for Vision Tasks" in PyTorch and Zeta☆16Updated last year
- ☆25Updated 4 years ago
- The official repo of our research work "Interactive Editing for Text Summarization".☆23Updated 2 years ago
- This repo contains data and code for the paper "Reasoning over Public and Private Data in Retrieval-Based Systems."☆46Updated last year
- DeFacto - Demonstrations and Feedback for improving factual consistency of text summarization☆30Updated 2 years ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated 2 years ago
- Submission to the inverse scaling prize☆23Updated 2 years ago
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆24Updated this week
- Official code release for the paper Coder Reviewer Reranking for Code Generation.☆45Updated 2 years ago
- [NeurIPS 2022] code for "K-LITE: Learning Transferable Visual Models with External Knowledge" https://arxiv.org/abs/2204.09222☆51Updated 2 years ago
- ☆44Updated 4 years ago
- An Implementation of "Orca: Progressive Learning from Complex Explanation Traces of GPT-4"☆44Updated last year
- SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…☆35Updated last year
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆49Updated 2 years ago
- Research publication code for "Forward Compatible Training for Large-Scale Embedding Retrieval Systems", CVPR 2022, and "FastFill: Effici…☆56Updated 2 years ago
- ☆10Updated last year
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆44Updated last year
- [COLM 2024] Early Weight Averaging meets High Learning Rates for LLM Pre-training☆18Updated last year
- ☆44Updated last year
- Tools for content datamining and NLP at scale☆44Updated last year
- The Next Generation Multi-Modality Superintelligence☆70Updated last year
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆50Updated 3 years ago
- Google Research☆46Updated 3 years ago
- ☆80Updated 8 months ago
- ☆44Updated last year
- An official codebase for paper " CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"☆52Updated 2 years ago
- Benchmarks for Business Document Foundation Models☆10Updated last year
- code for paper "Accessing higher dimensions for unsupervised word translation"☆22Updated 2 years ago
- Code for the paper "LASER: LLM Agent with State-Space Exploration for Web Navigation"☆33Updated 2 years ago