forkarinda / MFN
Multistage Fusion with Forget Gate for Multimodal Summarization in Open-Domain Videos
☆12Updated 4 years ago
Alternatives and similar repositories for MFN:
Users that are interested in MFN are comparing it to the libraries listed below
- Code for the paper Multimodal Abstractive Summarization with Trimodal Hierarchical Attention☆19Updated 3 years ago
- Official code and dataset link for ''VMSMO: Learning to Generate Multimodal Summary for Video-based News Articles''☆37Updated 3 years ago
- A Full-Scale Dataset for Multi-modal Summarization☆14Updated 3 years ago
- ☆24Updated 3 years ago
- "Can images help recognize entities? A study of the role of images for Multimodal NER" (W-NUT at EMNLP 2021)☆20Updated 3 years ago
- ☆14Updated 3 years ago
- Implementation of ConceptBert: Concept-Aware Representation for Visual Question Answering☆29Updated 10 months ago
- Pytorch Implementation of MUCKO(2020 IJCAI)☆20Updated 4 years ago
- [ACL-IJCNLP 2021] Self-Supervised Multimodal Opinion Summarization☆24Updated 11 months ago
- RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER☆76Updated last year
- ☆17Updated 3 years ago
- The code repository for EMNLP 2021 paper "Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarization".☆55Updated 3 years ago
- PyTorch implementation of "Debiased Visual Question Answering from Feature and Sample Perspectives" (NeurIPS 2021)☆25Updated 2 years ago
- Code for the paper BiST: Bi-directional Spatio-Temporal Reasoning for Video-Grounded Dialogues (EMNLP20)☆11Updated 3 years ago
- Cross-media Structured Common Space for Multimedia Event Extraction (ACL2020)☆71Updated last year
- Text-Image Relationships (ACL 2019)☆21Updated last year
- KM-BART: Knowledge Enhanced Multimodal BART for Visual Commonsense Generation☆30Updated 3 years ago
- Code for our IJCAI2020 paper: Overcoming Language Priors with Self-supervised Learning for Visual Question Answering☆50Updated 4 years ago
- [CVPR 2021] Counterfactual VQA: A Cause-Effect Look at Language Bias☆120Updated 3 years ago
- Official pytorch implementation of the AAAI 2021 paper "Semantic Grouping Network for Video Captioning"☆51Updated 3 years ago
- Dataset and codes for our IJCAI 2019 paper "Adapting BERT for Target-Oriented Multimodal Sentiment Classification"☆80Updated 4 years ago
- [Reproduce] Code for the EMNLP2018 paper "A Visual Attention Grounding Neural Model for Multimodal Machine Translation".☆11Updated 5 years ago
- Preprocessed Datasets for our Multimodal NER paper☆116Updated 2 years ago
- ROCK model for Knowledge-Based VQA in Videos☆30Updated 4 years ago
- Neural Machine Translation with universal Visual Representation (ICLR 2020)☆88Updated 4 years ago
- TCIC: Theme Concepts Learning Cross Language and Vision for Image Captioning in IJCAI2021.☆9Updated 3 years ago
- ☆35Updated 3 years ago
- ☆30Updated 4 years ago
- Code, Models and Datasets for OpenViDial Dataset☆131Updated 3 years ago
- A pytorch implementation of "Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering" for image captioning.☆47Updated 3 years ago