forkarinda / MFNLinks
Multistage Fusion with Forget Gate for Multimodal Summarization in Open-Domain Videos
☆12Updated 5 years ago
Alternatives and similar repositories for MFN
Users that are interested in MFN are comparing it to the libraries listed below
Sorting:
- Official code and dataset link for ''VMSMO: Learning to Generate Multimodal Summary for Video-based News Articles''☆36Updated 4 years ago
- Pytorch Implementation of MUCKO(2020 IJCAI)☆20Updated 5 years ago
- ☆180Updated 5 years ago
- Code for our IJCAI2020 paper: Overcoming Language Priors with Self-supervised Learning for Visual Question Answering☆52Updated 5 years ago
- Code for the paper Multimodal Abstractive Summarization with Trimodal Hierarchical Attention☆20Updated 3 years ago
- ☆30Updated 5 years ago
- Text-Image Relationships (ACL 2019)☆21Updated 2 years ago
- A Full-Scale Dataset for Multi-modal Summarization☆16Updated 3 years ago
- The code repository for EMNLP 2021 paper "Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarization".☆55Updated 3 years ago
- RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER☆76Updated 2 years ago
- Code for the paper BiST: Bi-directional Spatio-Temporal Reasoning for Video-Grounded Dialogues (EMNLP20)☆11Updated 5 months ago
- Implementation of ConceptBert: Concept-Aware Representation for Visual Question Answering☆31Updated last year
- Source code for paper "VD-PCR: Improving Visual Dialog with Pronoun Coreference Resolution"☆10Updated 3 years ago
- Resource and Code for ICME 2021 paper "MNRE: A Challenge Multimodal Dataset for Neural Relation Extraction with Visual Evidence in Social…☆66Updated 4 years ago
- Preprocessed Datasets for our Multimodal NER paper☆123Updated 2 years ago
- "Can images help recognize entities? A study of the role of images for Multimodal NER" (W-NUT at EMNLP 2021)☆21Updated 4 years ago
- Dataset and codes for our IJCAI 2019 paper "Adapting BERT for Target-Oriented Multimodal Sentiment Classification"☆86Updated 5 years ago
- KM-BART: Knowledge Enhanced Multimodal BART for Visual Commonsense Generation☆31Updated 4 years ago
- ☆15Updated 4 years ago
- A PyTorch reimplementation of bottom-up-attention models☆304Updated 3 years ago
- ☆25Updated 4 years ago
- ☆38Updated 3 years ago
- Code for Infusing Multi-Source Knowledge with Heterogeneous Graph Neural Network for Emotional Conversation Generation (AAAI21)☆26Updated 3 years ago
- MuKEA: Multimodal Knowledge Extraction and Accumulation for Knowledge-based Visual Question Answering☆99Updated 2 years ago
- Bottom-up attention model for image captioning and VQA, based on Faster R-CNN and Visual Genome☆23Updated 6 years ago
- A pytorch implementation of "Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering" for image captioning.☆47Updated 4 years ago
- An PyTorch reimplementation of bottom-up-attention models☆16Updated 4 years ago
- The source code of ACL 2020 paper: "Cross-Modality Relevance for Reasoning on Language and Vision"☆27Updated 4 years ago
- Research code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training"☆235Updated 4 years ago
- An updated PyTorch implementation of hengyuan-hu's version for 'Bottom-Up and Top-Down Attention for Image Captioning and Visual Question…☆35Updated 3 years ago