forkarinda / MFN
Multistage Fusion with Forget Gate for Multimodal Summarization in Open-Domain Videos
☆12Updated 4 years ago
Alternatives and similar repositories for MFN:
Users that are interested in MFN are comparing it to the libraries listed below
- A Full-Scale Dataset for Multi-modal Summarization☆14Updated 3 years ago
- Official code and dataset link for ''VMSMO: Learning to Generate Multimodal Summary for Video-based News Articles''☆36Updated 3 years ago
- Code for the paper Multimodal Abstractive Summarization with Trimodal Hierarchical Attention☆19Updated 3 years ago
- Pytorch Implementation of MUCKO(2020 IJCAI)☆19Updated 4 years ago
- "Can images help recognize entities? A study of the role of images for Multimodal NER" (W-NUT at EMNLP 2021)☆20Updated 3 years ago
- ☆14Updated 3 years ago
- [ACL-IJCNLP 2021] Self-Supervised Multimodal Opinion Summarization☆24Updated 9 months ago
- RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER☆73Updated last year
- The code repository for EMNLP 2021 paper "Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarization".☆55Updated 3 years ago
- KM-BART: Knowledge Enhanced Multimodal BART for Visual Commonsense Generation☆30Updated 3 years ago
- Official pytorch implementation of the AAAI 2021 paper "Semantic Grouping Network for Video Captioning"☆51Updated 3 years ago
- Code for the paper BiST: Bi-directional Spatio-Temporal Reasoning for Video-Grounded Dialogues (EMNLP20)☆11Updated 3 years ago
- Text-Image Relationships (ACL 2019)☆20Updated last year
- Preprocessed Datasets for our Multimodal NER paper☆115Updated 2 years ago
- PyTorch implementation of "Debiased Visual Question Answering from Feature and Sample Perspectives" (NeurIPS 2021)☆24Updated 2 years ago
- A pytorch implementation of "Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering" for image captioning.☆47Updated 3 years ago
- Neural Machine Translation with universal Visual Representation (ICLR 2020)☆87Updated 4 years ago
- Cross-media Structured Common Space for Multimedia Event Extraction (ACL2020)☆71Updated last year
- The PyTorch code of the AAAI2021 paper "Non-Autoregressive Coarse-to-Fine Video Captioning".☆58Updated last year
- Code for our IJCAI2020 paper: Overcoming Language Priors with Self-supervised Learning for Visual Question Answering☆49Updated 4 years ago
- ☆12Updated 2 years ago
- ☆30Updated 4 years ago
- An PyTorch reimplementation of bottom-up-attention models☆16Updated 4 years ago
- ACM MULTIMEDIA CONFERENCE 2020☆11Updated 4 years ago
- code for paper `MemCap: Memorizing Style Knowledge for Image Captioning`☆11Updated 4 years ago
- TCIC: Theme Concepts Learning Cross Language and Vision for Image Captioning in IJCAI2021.☆9Updated 3 years ago
- Position Focused Attention Network for Image-Text Matching☆68Updated 5 years ago
- Support extracting BUTD features for NLVR2 images.☆18Updated 4 years ago
- ☆24Updated 3 years ago
- Multimodal Model for Memotion Dataset☆11Updated 3 years ago