Muennighoff / vilioLinks
🥶Vilio: State-of-the-art VL models in PyTorch & PaddlePaddle
☆90Updated 2 years ago
Alternatives and similar repositories for vilio
Users that are interested in vilio are comparing it to the libraries listed below
Sorting:
- ☆93Updated 2 years ago
- ☆66Updated 2 years ago
- [TACL 2021] Code and data for the framework in "Multimodal Pretraining Unmasked: A Meta-Analysis and a Unified Framework of Vision-and-La…☆114Updated 3 years ago
- PyTorch code for EMNLP 2020 Paper "Vokenization: Improving Language Understanding with Visual Supervision"☆190Updated 4 years ago
- ☆131Updated 2 years ago
- ☆45Updated 3 months ago
- An implementation that downstreams pre-trained V+L models to VQA tasks. Now support: VisualBERT, LXMERT, and UNITER☆165Updated 2 years ago
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": UNITER…☆119Updated 4 years ago
- [CVPR 2020] Transform and Tell: Entity-Aware News Image Captioning☆92Updated last year
- A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"☆83Updated 3 years ago
- PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)☆372Updated 2 years ago
- BERT + Image Captioning☆134Updated 4 years ago
- Repository containing code from team Kingsterdam for the Hateful Memes Challenge☆22Updated 2 years ago
- Code of Dense Relational Captioning☆69Updated 2 years ago
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": LXMERT…☆21Updated 4 years ago
- ☆53Updated 3 years ago
- Dataset and starting code for visual entailment dataset☆112Updated 3 years ago
- Supervised Multimodal Bitransformers for Classifying Images and Text☆255Updated 4 years ago
- Implementation for "Large-scale Pretraining for Visual Dialog" https://arxiv.org/abs/1912.02379☆97Updated 5 years ago
- Multitask Multilingual Multimodal Pre-training☆71Updated 2 years ago
- 12-in-1: Multi-Task Vision and Language Representation Learning Web Demo☆35Updated 2 years ago
- Good News Everyone! - CVPR 2019☆128Updated 3 years ago
- Code associated with the "Natural Language Rationales with Full-Stack Visual Reasoning" EMNLP Findings 2020 paper☆24Updated 4 years ago
- Support extracting BUTD features for NLVR2 images.☆18Updated 5 years ago
- Code and Resources for the Transformer Encoder Reasoning Network (TERN) - https://arxiv.org/abs/2004.09144☆58Updated last year
- Code for the paper "VisualBERT: A Simple and Performant Baseline for Vision and Language"☆537Updated 2 years ago
- Transformer-based image captioning extension for pytorch/fairseq☆317Updated 4 years ago
- Baseline model for multimodal classification based on images and text. Text representation obtained from pretrained BERT base model and i…☆41Updated 3 years ago
- source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT☆72Updated 2 years ago
- Show, Edit and Tell: A Framework for Editing Image Captions, CVPR 2020☆81Updated 5 years ago