zhegan27 / VILLA
Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": UNITER adversarial training part
☆119Updated 4 years ago
Alternatives and similar repositories for VILLA:
Users that are interested in VILLA are comparing it to the libraries listed below
- Counterfactual Samples Synthesizing for Robust VQA☆77Updated 2 years ago
- ☆62Updated 3 years ago
- NeurIPS 2019 Paper: RUBi : Reducing Unimodal Biases for Visual Question Answering☆59Updated 3 years ago
- Code for "Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representations" (NeurIPS 2019)☆65Updated 4 years ago
- Starter Code for VALUE benchmark☆80Updated 2 years ago
- source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT☆73Updated 2 years ago
- ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration☆56Updated last year
- A paper list of visual semantic embeddings and text-image retrieval.☆41Updated 4 years ago
- Compact Trilinear Interaction for Visual Question Answering (ICCV 2019)☆38Updated 2 years ago
- Code for CVPR'19 "Recursive Visual Attention in Visual Dialog"☆64Updated last year
- Multitask Multilingual Multimodal Pre-training☆71Updated 2 years ago
- Research Code for ICCV 2019 paper "Relation-aware Graph Attention Network for Visual Question Answering"☆182Updated 3 years ago
- Implementation for MAF: Multimodal Alignment Framework☆44Updated 4 years ago
- Dataset and starting code for visual entailment dataset☆109Updated 2 years ago
- ☆44Updated 2 years ago
- The source code of ACL 2020 paper: "Cross-Modality Relevance for Reasoning on Language and Vision"☆26Updated 3 years ago
- Human-like Controllable Image Captioning with Verb-specific Semantic Roles.☆36Updated 2 years ago
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": LXMERT…☆21Updated 4 years ago
- Show, Edit and Tell: A Framework for Editing Image Captions, CVPR 2020☆80Updated 4 years ago
- Code for the model "Heterogeneous Graph Learning for Visual Commonsense Reasoning (NeurlPS 2019)"☆47Updated 4 years ago
- Support extracting BUTD features for NLVR2 images.☆18Updated 4 years ago
- [TACL 2021] Code and data for the framework in "Multimodal Pretraining Unmasked: A Meta-Analysis and a Unified Framework of Vision-and-La…☆114Updated 2 years ago
- Implementation for "Large-scale Pretraining for Visual Dialog" https://arxiv.org/abs/1912.02379☆96Updated 4 years ago
- PyTorch code for: Learning to Generate Grounded Visual Captions without Localization Supervision☆44Updated 4 years ago
- Learning phrase grounding from captioned images through InfoNCE bound on mutual information☆72Updated 4 years ago
- [CVPR 2020] Transform and Tell: Entity-Aware News Image Captioning☆90Updated 10 months ago
- Data Release for VALUE Benchmark☆31Updated 3 years ago
- [CVPR 2021] Counterfactual VQA: A Cause-Effect Look at Language Bias☆120Updated 3 years ago
- Unpaired Image Captioning☆35Updated 3 years ago
- Grid features pre-training code for visual question answering☆268Updated 3 years ago