airsplay / vokenization
PyTorch code for EMNLP 2020 Paper "Vokenization: Improving Language Understanding with Visual Supervision"
☆186Updated 3 years ago
Alternatives and similar repositories for vokenization:
Users that are interested in vokenization are comparing it to the libraries listed below
- [TACL 2021] Code and data for the framework in "Multimodal Pretraining Unmasked: A Meta-Analysis and a Unified Framework of Vision-and-La…☆114Updated 2 years ago
- ☆53Updated 3 years ago
- ☆44Updated 2 years ago
- Implementation for "Large-scale Pretraining for Visual Dialog" https://arxiv.org/abs/1912.02379☆96Updated 4 years ago
- MERLOT: Multimodal Neural Script Knowledge Models☆223Updated 2 years ago
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": UNITER…☆119Updated 4 years ago
- Pre-trained V+L Data Preparation☆45Updated 4 years ago
- Dataset and starting code for visual entailment dataset☆109Updated 2 years ago
- Source code for "Transforming Question Answering Datasets Into Natural Language Inference Datasets"☆60Updated 5 years ago
- Code associated with the "Natural Language Rationales with Full-Stack Visual Reasoning" EMNLP Findings 2020 paper☆24Updated 4 years ago
- VisualCOMET: Reasoning about the Dynamic Context of a Still Image☆85Updated last year
- Pytorch version of VidLanKD: Improving Language Understanding viaVideo-Distilled Knowledge Transfer (NeurIPS 2021))☆56Updated 2 years ago
- Code for the paper Multimodal Transformer Networks for End-to-End Video-Grounded Dialogue Systems (ACL19)☆98Updated 2 years ago
- Unicoder model for understanding and generation.☆89Updated last year
- [ICML 2022] Code and data for our paper "IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages"☆49Updated 2 years ago
- Encoder-Agnostic Adaptation for Conditional Language Generation☆79Updated 6 months ago
- ☆116Updated 2 years ago
- Neural Machine Translation with universal Visual Representation (ICLR 2020)☆87Updated 4 years ago
- PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)☆367Updated last year
- Extended Intramodal and Intermodal Semantic Similarity Judgments for MS-COCO☆51Updated 4 years ago
- Code for SIMMC 2.0: A Task-oriented Dialog Dataset for Immersive Multimodal Conversations☆105Updated 2 years ago
- [NAACL 2021] Factual Probing Is [MASK]: Learning vs. Learning to Recall https://arxiv.org/abs/2104.05240☆167Updated 2 years ago
- code and data for EMNLP-19 paper "Counterfactual Story Reasoning and Generation" https://arxiv.org/abs/1909.04076☆101Updated 4 years ago
- Implementation of "Visualize Before You Write: Imagination-Guided Open-Ended Text Generation".☆17Updated 2 years ago
- Multitask Multilingual Multimodal Pre-training☆71Updated 2 years ago
- Code for CVPR'19 "Recursive Visual Attention in Visual Dialog"☆64Updated last year
- Neural Module Network for Reasoning over Text, ICLR 2020☆121Updated 4 years ago
- ☆69Updated 10 months ago
- Implementation of Marge, Pre-training via Paraphrasing, in Pytorch☆75Updated 4 years ago
- Information Maximizing Visual Question Generation☆66Updated last year