google-research-datasets / witLinks
WIT (Wikipedia-based Image Text) Dataset is a large multimodal multilingual dataset comprising 37M+ image-text sets with 11M+ unique images across 100+ languages.
☆1,058Updated 8 months ago
Alternatives and similar repositories for wit
Users that are interested in wit are comparing it to the libraries listed below
Sorting:
- Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch☆1,244Updated 2 years ago
- OpenAI CLIP text encoders for multiple languages!☆799Updated 2 years ago
- Code release for SLIP Self-supervision meets Language-Image Pre-training☆767Updated 2 years ago
- A concise but complete implementation of CLIP with various experimental improvements from recent papers☆711Updated last year
- Conceptual 12M is a dataset containing (image-URL, caption) pairs collected for vision-and-language pre-training.☆391Updated 2 years ago
- Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch☆866Updated last year
- A PyTorch Lightning solution to training OpenAI's CLIP from scratch.☆694Updated 3 years ago
- Oscar and VinVL☆1,049Updated last year
- CLIP-like model evaluation☆721Updated 2 weeks ago
- PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)☆371Updated last year
- Research code for pixel-based encoders of language (PIXEL)☆335Updated last year
- [CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning…☆721Updated last year
- Language Models Can See: Plugging Visual Controls in Text Generation☆256Updated 3 years ago
- [ICLR 2022] code for "How Much Can CLIP Benefit Vision-and-Language Tasks?" https://arxiv.org/abs/2107.06383☆411Updated 2 years ago
- Conceptual Captions is a dataset containing (image-URL, caption) pairs designed for the training and evaluation of machine learned image …☆541Updated 3 years ago
- Simple image captioning model☆1,372Updated 11 months ago
- Robust fine-tuning of zero-shot models☆705Updated 3 years ago
- 🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".☆482Updated last year
- TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.☆1,604Updated last week
- DataComp: In search of the next generation of multimodal datasets☆714Updated last month
- GIT: A Generative Image-to-text Transformer for Vision and Language☆566Updated last year
- ☆1,008Updated 2 years ago
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways☆823Updated 2 years ago
- Multi Task Vision and Language☆812Updated 3 years ago
- Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"☆793Updated 3 years ago
- Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence L…☆2,502Updated last year
- NL-Augmenter 🦎 → 🐍 A Collaborative Repository of Natural Language Transformations☆786Updated last year
- Code for the paper "VisualBERT: A Simple and Performant Baseline for Vision and Language"☆535Updated 2 years ago
- MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.☆930Updated 2 months ago
- Vision-Language Pre-training for Image Captioning and Question Answering☆419Updated 3 years ago