airsplay / vokenization
PyTorch code for EMNLP 2020 Paper "Vokenization: Improving Language Understanding with Visual Supervision"
☆186Updated 3 years ago
Related projects: ⓘ
- [TACL 2021] Code and data for the framework in "Multimodal Pretraining Unmasked: A Meta-Analysis and a Unified Framework of Vision-and-La…☆113Updated 2 years ago
- Implementation for "Large-scale Pretraining for Visual Dialog" https://arxiv.org/abs/1912.02379☆95Updated 4 years ago
- ☆51Updated 2 years ago
- ☆45Updated last year
- With the aim of building next generation virtual assistants that can handle multimodal inputs and perform multimodal actions, we introduc…☆130Updated 10 months ago
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": UNITER…☆119Updated 3 years ago
- ☆109Updated last year
- Code for SIMMC 2.0: A Task-oriented Dialog Dataset for Immersive Multimodal Conversations☆103Updated last year
- MERLOT: Multimodal Neural Script Knowledge Models☆224Updated 2 years ago
- VisualCOMET: Reasoning about the Dynamic Context of a Still Image☆85Updated last year
- Dataset and starting code for visual entailment dataset☆107Updated 2 years ago
- PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)☆357Updated last year
- Pytorch version of VidLanKD: Improving Language Understanding viaVideo-Distilled Knowledge Transfer (NeurIPS 2021))☆56Updated last year
- VisualMRC: Machine Reading Comprehension on Document Images (AAAI2021)☆51Updated 3 years ago
- GLAC Net: GLocal Attention Cascading Network for the Visual Storytelling Challenge☆43Updated 4 years ago
- Extended Intramodal and Intermodal Semantic Similarity Judgments for MS-COCO☆49Updated 4 years ago
- Code for the paper Multimodal Transformer Networks for End-to-End Video-Grounded Dialogue Systems (ACL19)☆98Updated last year
- A reference-free metric for measuring summary quality, learned from human ratings.☆42Updated last year
- Multitask Multilingual Multimodal Pre-training☆68Updated last year
- Neural Machine Translation with universal Visual Representation (ICLR 2020)☆87Updated 4 years ago
- Code associated with the "Natural Language Rationales with Full-Stack Visual Reasoning" EMNLP Findings 2020 paper☆24Updated 3 years ago
- PyTorch original implementation of "Unsupervised Question Decomposition for Question Answering"☆119Updated last year
- Neural Module Network for Reasoning over Text, ICLR 2020☆122Updated 3 years ago
- Information Maximizing Visual Question Generation☆66Updated 11 months ago
- A BART version of an open-domain QA model in a closed-book setup☆120Updated 4 years ago
- [ICML 2022] Code and data for our paper "IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages"☆49Updated last year
- [CVPR 2020] Transform and Tell: Entity-Aware News Image Captioning☆89Updated 5 months ago
- Code and Experiments for ACL-IJCNLP 2021 Paper "Mind Your Outliers! Investigating the Negative Impact of Outliers on Active Learning for …☆56Updated 2 years ago
- Implementation of "Visualize Before You Write: Imagination-Guided Open-Ended Text Generation".☆17Updated last year
- ☆26Updated 4 months ago