malihealikhani / Cross-modal_Coherence_Modeling
Cross-modal Coherence Modeling for Caption Generation
☆11Updated 4 years ago
Related projects: ⓘ
- Dataset and models for paper "Game-Based Video-Context Dialogue (EMNLP 2018)"☆19Updated 5 years ago
- DSTC8-AVSD: Sentence generation task for Audio Visual Scene-aware Dialog☆14Updated 3 years ago
- "What is Learned in Visually Grounded Neural Syntax Acquisition", Noriyuki Kojima, Hadar Averbuch-Elor, Alexander Rush and Yoav Artzi (AC…☆12Updated 2 years ago
- Repository for AAAI 2018 paper "Using Syntax for Referring Expression Recognition"☆13Updated 3 years ago
- Implementation of "MULE: Multimodal Universal Language Embedding"☆15Updated 4 years ago
- vist story telling evaluation tool☆21Updated 9 months ago
- Generate a denotation graph from a set of image captions☆15Updated 6 years ago
- Code for "Counterfactual Variable Control for Robust and Interpretable Question Answering"☆14Updated 3 years ago
- Code for "bootstrap, review, decode: using out-of-domain textual data to improve image captioning"☆20Updated 7 years ago
- ☆45Updated last year
- Visually Grounded PCFG Induction☆39Updated 2 years ago
- Code for Unsupervised Discovery of Multimodal Links in Multi-Image/Multi-Sentence Documents☆30Updated 4 years ago
- Code for the CoNLL 2019 paper "Compositional Generalization in Image Captioning" by Mitja Nikolaus, Mostafa Abdou, Matthew Lamm, Rahul Ar…☆26Updated 4 years ago
- Official Github repo of the VIST Challenge NAACL 2018☆17Updated 6 years ago
- Pytorch implementation of https://arxiv.org/pdf/1909.10470.pdf☆32Updated 3 years ago
- Pytorch version of VidLanKD: Improving Language Understanding viaVideo-Distilled Knowledge Transfer (NeurIPS 2021))☆56Updated last year
- Implementation of Soft-Label Chain Conditional Random Field for Phrase Grounding in PyTorch☆15Updated last year
- ☆27Updated 4 years ago
- implement n2nmn with pytorch☆19Updated 5 years ago
- Unsupervised specificity-guided optimization of Image Captioning models to encourage meaningful diversity in the generated captions.☆13Updated 5 years ago
- Code for the paper Multimodal Transformer Networks for End-to-End Video-Grounded Dialogue Systems (ACL19)☆98Updated last year
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": LXMERT…☆21Updated 3 years ago
- Pre-trained V+L Data Preparation☆45Updated 4 years ago
- Evaluating and improving the faithfulness of the interpretations offered by Neural Module Networks☆13Updated last year
- ☆29Updated 5 years ago
- Code and data for the project "Visually grounded continual learning of compositional semantics"☆21Updated last year
- [EMNLP 2021] Code and data for our paper "Visually Grounded Reasoning across Languages and Cultures"☆28Updated 2 years ago
- Evaluating Visual Fidelity of Image Descriptions☆11Updated 5 years ago
- Code and Data for the paper Investigating Evaluation of Open-Domain Dialogue Systems With Human Generated Multiple References SIGdial 201…☆28Updated 4 years ago
- Code for ViLBERTScore in EMNLP Eval4NLP☆17Updated last year