forkarinda / MFNLinks
Multistage Fusion with Forget Gate for Multimodal Summarization in Open-Domain Videos
☆12Updated 4 years ago
Alternatives and similar repositories for MFN
Users that are interested in MFN are comparing it to the libraries listed below
Sorting:
- Code for the paper Multimodal Abstractive Summarization with Trimodal Hierarchical Attention☆20Updated 3 years ago
- Official code and dataset link for ''VMSMO: Learning to Generate Multimodal Summary for Video-based News Articles''☆36Updated 3 years ago
- A Full-Scale Dataset for Multi-modal Summarization☆15Updated 3 years ago
- "Can images help recognize entities? A study of the role of images for Multimodal NER" (W-NUT at EMNLP 2021)☆20Updated 3 years ago
- Preprocessed Datasets for our Multimodal NER paper☆120Updated 2 years ago
- The code repository for EMNLP 2021 paper "Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarization".☆55Updated 3 years ago
- RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER☆75Updated 2 years ago
- ☆14Updated 4 years ago
- Pytorch Implementation of MUCKO(2020 IJCAI)☆20Updated 4 years ago
- ☆24Updated 4 years ago
- Code for our IJCAI2020 paper: Overcoming Language Priors with Self-supervised Learning for Visual Question Answering☆51Updated 4 years ago
- KM-BART: Knowledge Enhanced Multimodal BART for Visual Commonsense Generation☆31Updated 3 years ago
- Text-Image Relationships (ACL 2019)☆21Updated last year
- Code for the paper BiST: Bi-directional Spatio-Temporal Reasoning for Video-Grounded Dialogues (EMNLP20)☆11Updated last week
- ☆17Updated 2 years ago
- Dataset and codes for our IJCAI 2019 paper "Adapting BERT for Target-Oriented Multimodal Sentiment Classification"☆81Updated 5 years ago
- Resource and Code for ICME 2021 paper "MNRE: A Challenge Multimodal Dataset for Neural Relation Extraction with Visual Evidence in Social…☆56Updated 3 years ago
- Multi-modal Graph Fusion for Named Entity Recognition with Targeted Visual Guidance☆66Updated 8 months ago
- Neural Machine Translation with universal Visual Representation (ICLR 2020)☆88Updated 4 years ago
- Cross-media Structured Common Space for Multimedia Event Extraction (ACL2020)☆73Updated last year
- Code for Infusing Multi-Source Knowledge with Heterogeneous Graph Neural Network for Emotional Conversation Generation (AAAI21)☆26Updated 3 years ago
- ☆35Updated 2 years ago
- A pytorch implementation of "Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering" for image captioning.☆47Updated 3 years ago
- Official pytorch implementation of the AAAI 2021 paper "Semantic Grouping Network for Video Captioning"☆54Updated 3 years ago
- [CVPR 2021] Counterfactual VQA: A Cause-Effect Look at Language Bias☆121Updated 3 years ago
- ☆13Updated 2 years ago
- MuKEA: Multimodal Knowledge Extraction and Accumulation for Knowledge-based Visual Question Answering☆96Updated 2 years ago
- ☆27Updated 3 years ago
- Assist Non-native Viewers: Multimodal Crosslingual Summarization for How2 Videos☆10Updated 9 months ago
- Source code for multimodal dialogue systems with semantic elements (MATE, He et al., 2020).☆8Updated 3 years ago