VisionLearningGroup / MULE
Implementation of "MULE: Multimodal Universal Language Embedding"
☆15Updated 4 years ago
Related projects: ⓘ
- Generate a denotation graph from a set of image captions☆15Updated 6 years ago
- Cross-modal Coherence Modeling for Caption Generation☆11Updated 4 years ago
- Pre-trained V+L Data Preparation☆45Updated 4 years ago
- Implementation of Diverse and Accurate Image Description Using a Variational Auto-Encoder with an Additive Gaussian Encoding Space☆57Updated 6 years ago
- ☆29Updated 5 years ago
- implement n2nmn with pytorch☆19Updated 5 years ago
- Code for Unsupervised Discovery of Multimodal Links in Multi-Image/Multi-Sentence Documents☆30Updated 4 years ago
- Pytorch implementation of https://arxiv.org/pdf/1909.10470.pdf☆32Updated 3 years ago
- Implementation of Soft-Label Chain Conditional Random Field for Phrase Grounding in PyTorch☆15Updated last year
- For visual commonsense model☆34Updated 5 years ago
- Code for "bootstrap, review, decode: using out-of-domain textual data to improve image captioning"☆20Updated 7 years ago
- Transfer Learning via Unsupervised Task Discovery for Visual Question Answering☆32Updated 5 years ago
- Code for the model "Heterogeneous Graph Learning for Visual Commonsense Reasoning (NeurlPS 2019)"☆46Updated 4 years ago
- Data of ACL 2019 Paper "Expressing Visual Relationships via Language".☆62Updated 3 years ago
- Code release for Hu et al., Explainable Neural Computation via Stack Neural Module Networks. in ECCV, 2018☆72Updated 4 years ago
- Connective Cognition Network for Directional Visual Commonsense Reasoning☆15Updated 3 years ago
- Repository to generate CLEVR-Dialog: A diagnostic dataset for Visual Dialog☆44Updated 4 years ago
- Models and Codes for the paper Question Relevance in VQA: Identifying Non-Visual And False-Premise Questions☆15Updated 6 years ago
- Code for "simNet: Stepwise Image-Topic Merging Network for Generating Detailed and Comprehensive Image Captions" （EMNLP 2018）☆37Updated 6 years ago
- An image-oriented evaluation tool for image captioning systems (EMNLP-IJCNLP 2019)☆33Updated 4 years ago
- Code for the CoNLL 2019 paper "Compositional Generalization in Image Captioning" by Mitja Nikolaus, Mostafa Abdou, Matthew Lamm, Rahul Ar…☆26Updated 4 years ago
- DSTC8-AVSD: Sentence generation task for Audio Visual Scene-aware Dialog☆14Updated 3 years ago
- ☆33Updated this week
- Referring expression comprehension on ReferIt(RefClef)☆10Updated 7 years ago
- An unofficial PyTorch implementation of the HAN and AdaHAN models presented in the "Learning Visual Question Answering by Bootstrapping H…☆53Updated 6 years ago
- Evaluating Visual Fidelity of Image Descriptions☆11Updated 5 years ago
- Multi-sense word embeddings from visual co-occurrences☆25Updated 5 years ago
- A simple but well-performing "single-hop" visual attention model for the GQA dataset☆20Updated 5 years ago
- ☆27Updated 4 years ago
- Visual Coreference Resolution in Visual Dialog using Neural Module Networks☆57Updated 2 years ago