VisionLearningGroup / MULE
Implementation of "MULE: Multimodal Universal Language Embedding"
☆16Updated 5 years ago
Alternatives and similar repositories for MULE:
Users that are interested in MULE are comparing it to the libraries listed below
- Cross-modal Coherence Modeling for Caption Generation☆11Updated 4 years ago
- implement n2nmn with pytorch☆19Updated 5 years ago
- Transfer Learning via Unsupervised Task Discovery for Visual Question Answering☆31Updated 5 years ago
- Pre-trained V+L Data Preparation☆45Updated 4 years ago
- Generate a denotation graph from a set of image captions☆15Updated 6 years ago
- [EMNLP 2021] Code and data for our paper "Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers…☆20Updated 3 years ago
- Implementation of Soft-Label Chain Conditional Random Field for Phrase Grounding in PyTorch☆15Updated 2 years ago
- Code for "Counterfactual Variable Control for Robust and Interpretable Question Answering"☆14Updated 4 years ago
- Code for "bootstrap, review, decode: using out-of-domain textual data to improve image captioning"☆20Updated 8 years ago
- Visual Coreference Resolution in Visual Dialog using Neural Module Networks☆57Updated 3 years ago
- ☆44Updated 2 years ago
- Code release for Hu et al., Explainable Neural Computation via Stack Neural Module Networks. in ECCV, 2018☆71Updated 5 years ago
- Pytorch implementation of https://arxiv.org/pdf/1909.10470.pdf☆32Updated 3 years ago
- Data of ACL 2019 Paper "Expressing Visual Relationships via Language".☆62Updated 4 years ago
- ☆53Updated 5 years ago
- An image-oriented evaluation tool for image captioning systems (EMNLP-IJCNLP 2019)☆36Updated 4 years ago
- DSTC8-AVSD: Sentence generation task for Audio Visual Scene-aware Dialog☆14Updated 3 years ago
- Code for the model "Heterogeneous Graph Learning for Visual Commonsense Reasoning (NeurlPS 2019)"☆47Updated 4 years ago
- Implementation of Diverse and Accurate Image Description Using a Variational Auto-Encoder with an Additive Gaussian Encoding Space☆58Updated 6 years ago
- Code for the CoNLL 2019 paper "Compositional Generalization in Image Captioning" by Mitja Nikolaus, Mostafa Abdou, Matthew Lamm, Rahul Ar…☆26Updated 4 years ago
- ☆30Updated 6 years ago
- ☆13Updated 5 years ago
- Repository to generate CLEVR-Dialog: A diagnostic dataset for Visual Dialog☆46Updated 5 years ago
- Pytorch version of VidLanKD: Improving Language Understanding viaVideo-Distilled Knowledge Transfer (NeurIPS 2021))☆56Updated 2 years ago
- Code and data for the project "Visually grounded continual learning of compositional semantics"☆21Updated 2 years ago
- Referring expression comprehension on ReferIt(RefClef)☆9Updated 8 years ago
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": LXMERT…☆21Updated 4 years ago
- ☆27Updated 4 years ago
- Repository for AAAI 2018 paper "Using Syntax for Referring Expression Recognition"☆12Updated 4 years ago
- Measure the diversity of image descriptions, repository for our COLING 2018 paper.☆13Updated 5 years ago