Muennighoff / vilioLinks
π₯ΆVilio: State-of-the-art VL models in PyTorch & PaddlePaddle
β90Updated 2 years ago
Alternatives and similar repositories for vilio
Users that are interested in vilio are comparing it to the libraries listed below
Sorting:
- β93Updated 3 years ago
- An implementation that downstreams pre-trained V+L models to VQA tasks. Now support: VisualBERT, LXMERT, and UNITERβ165Updated 3 years ago
- β44Updated 6 months ago
- β67Updated 2 years ago
- [TACL 2021] Code and data for the framework in "Multimodal Pretraining Unmasked: A Meta-Analysis and a Unified Framework of Vision-and-Laβ¦β114Updated 3 years ago
- PyTorch code for EMNLP 2020 Paper "Vokenization: Improving Language Understanding with Visual Supervision"β192Updated 4 years ago
- Repository containing code from team Kingsterdam for the Hateful Memes Challengeβ22Updated 3 years ago
- β131Updated 3 years ago
- [CVPR 2020] Transform and Tell: Entity-Aware News Image Captioningβ93Updated last year
- β53Updated 4 years ago
- Code of Dense Relational Captioningβ69Updated 2 years ago
- A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"β83Updated 3 years ago
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": UNITERβ¦β119Updated 4 years ago
- 12-in-1: Multi-Task Vision and Language Representation Learning Web Demoβ35Updated 3 years ago
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": LXMERTβ¦β21Updated 5 years ago
- Implementation for "Large-scale Pretraining for Visual Dialog" https://arxiv.org/abs/1912.02379β97Updated 5 years ago
- BERT + Image Captioningβ135Updated 4 years ago
- β40Updated 3 years ago
- Code associated with the "Natural Language Rationales with Full-Stack Visual Reasoning" EMNLP Findings 2020 paperβ24Updated 4 years ago
- MERLOT: Multimodal Neural Script Knowledge Modelsβ225Updated 3 years ago
- Dataset and starting code for visual entailment datasetβ118Updated 3 years ago
- Multitask Multilingual Multimodal Pre-trainingβ72Updated 3 years ago
- Support extracting BUTD features for NLVR2 images.β18Updated 5 years ago
- We rank the 1st in DSTC8 Audio-Visual Scene-Aware Dialog competition. This is the source code for our IEEE/ACM TASLP (AAAI2020-DSTC8-AVSDβ¦β56Updated 2 years ago
- Good News Everyone! - CVPR 2019β128Updated 3 years ago
- Neural Machine Translation with universal Visual Representation (ICLR 2020)β89Updated 5 years ago
- Show, Edit and Tell: A Framework for Editing Image Captions, CVPR 2020β81Updated 5 years ago
- A dataset of crowdsourced ratings for machine-generated image captionsβ38Updated 6 years ago
- Code and Resources for the Transformer Encoder Reasoning Network (TERN) - https://arxiv.org/abs/2004.09144β58Updated 2 years ago
- PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)β374Updated 2 years ago