dandelin / ViLTLinks
Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"
☆1,499Updated last year
Alternatives and similar repositories for ViLT
Users that are interested in ViLT are comparing it to the libraries listed below
Sorting:
- Code for ALBEF: a new vision-language pre-training method☆1,718Updated 3 years ago
- Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"☆798Updated 4 years ago
- Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch☆1,181Updated last year
- Recent Advances in Vision and Language PreTrained Models (VL-PTMs)☆1,155Updated 3 years ago
- Multi Task Vision and Language☆818Updated 3 years ago
- An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"☆991Updated last year
- Oscar and VinVL☆1,050Updated 2 years ago
- Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence L…☆2,535Updated last year
- PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057☆1,298Updated 3 years ago
- X-VLM: Multi-Grained Vision Language Pre-Training (ICML 2022)☆485Updated 2 years ago
- [ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decode…☆869Updated 2 years ago
- Prompt Learning for Vision-Language Models (IJCV'22, CVPR'22)☆2,087Updated last year
- A PyTorch Lightning solution to training OpenAI's CLIP from scratch.☆713Updated 3 years ago
- Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm☆666Updated 3 years ago
- ☆1,033Updated 3 years ago
- PyTorch code for EMNLP 2019 paper "LXMERT: Learning Cross-Modality Encoder Representations from Transformers".☆963Updated 3 years ago
- [CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning…☆722Updated 2 years ago
- awesome grounding: A curated list of research papers in visual grounding☆1,114Updated last month
- Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).☆1,218Updated last year
- METER: A Multimodal End-to-end TransformER Framework☆373Updated 2 years ago
- TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.☆1,654Updated last week
- ❄️🔥 Visual Prompt Tuning [ECCV 2022] https://arxiv.org/abs/2203.12119☆1,173Updated 2 years ago
- Simple image captioning model☆1,394Updated last year
- Grounded Language-Image Pre-training☆2,516Updated last year
- Recent Transformer-based CV and related works.☆1,333Updated 2 years ago
- [ICLR 2022] code for "How Much Can CLIP Benefit Vision-and-Language Tasks?" https://arxiv.org/abs/2107.06383☆415Updated 2 years ago
- Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch☆1,265Updated 3 years ago
- iBOT : Image BERT Pre-Training with Online Tokenizer (ICLR 2022)☆748Updated 3 years ago
- Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".☆746Updated 2 years ago
- [ACL'19] [PyTorch] Multimodal Transformer☆920Updated 3 years ago