forkarinda / MFNLinks
Multistage Fusion with Forget Gate for Multimodal Summarization in Open-Domain Videos
☆12Updated 4 years ago
Alternatives and similar repositories for MFN
Users that are interested in MFN are comparing it to the libraries listed below
Sorting:
- Official code and dataset link for ''VMSMO: Learning to Generate Multimodal Summary for Video-based News Articles''☆36Updated 3 years ago
- A Full-Scale Dataset for Multi-modal Summarization☆14Updated 3 years ago
- "Can images help recognize entities? A study of the role of images for Multimodal NER" (W-NUT at EMNLP 2021)☆20Updated 3 years ago
- ☆14Updated 4 years ago
- Code for the paper Multimodal Abstractive Summarization with Trimodal Hierarchical Attention☆20Updated 3 years ago
- Pytorch Implementation of MUCKO(2020 IJCAI)☆20Updated 4 years ago
- The code repository for EMNLP 2021 paper "Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarization".☆55Updated 3 years ago
- [ACL-IJCNLP 2021] Self-Supervised Multimodal Opinion Summarization☆24Updated last year
- RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER☆75Updated 2 years ago
- Preprocessed Datasets for our Multimodal NER paper☆120Updated 2 years ago
- ☆30Updated 4 years ago
- ☆24Updated 3 years ago
- KM-BART: Knowledge Enhanced Multimodal BART for Visual Commonsense Generation☆31Updated 3 years ago
- Dataset and codes for our IJCAI 2019 paper "Adapting BERT for Target-Oriented Multimodal Sentiment Classification"☆81Updated 5 years ago
- Code for the paper BiST: Bi-directional Spatio-Temporal Reasoning for Video-Grounded Dialogues (EMNLP20)☆11Updated 3 years ago
- Official pytorch implementation of the AAAI 2021 paper "Semantic Grouping Network for Video Captioning"☆53Updated 3 years ago
- Code for Infusing Multi-Source Knowledge with Heterogeneous Graph Neural Network for Emotional Conversation Generation (AAAI21)☆26Updated 3 years ago
- ROCK model for Knowledge-Based VQA in Videos☆30Updated 4 years ago
- TCIC: Theme Concepts Learning Cross Language and Vision for Image Captioning in IJCAI2021.☆9Updated 3 years ago
- A pytorch implementation of "Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering" for image captioning.☆47Updated 3 years ago
- Neural Machine Translation with universal Visual Representation (ICLR 2020)☆88Updated 4 years ago
- ☆27Updated 3 years ago
- [Reproduce] Code for the EMNLP2018 paper "A Visual Attention Grounding Neural Model for Multimodal Machine Translation".☆11Updated 5 years ago
- Text-Image Relationships (ACL 2019)☆21Updated last year
- Code for our IJCAI2020 paper: Overcoming Language Priors with Self-supervised Learning for Visual Question Answering☆51Updated 4 years ago
- The PyTorch code of the AAAI2021 paper "Non-Autoregressive Coarse-to-Fine Video Captioning".☆58Updated last year
- Assist Non-native Viewers: Multimodal Crosslingual Summarization for How2 Videos☆10Updated 9 months ago
- ☆16Updated 2 years ago
- ☆35Updated 2 years ago
- PyTorch implementation of "Debiased Visual Question Answering from Feature and Sample Perspectives" (NeurIPS 2021)☆25Updated 2 years ago