githwd2016 / MATE
Source code for multimodal dialogue systems with semantic elements (MATE, He et al., 2020).
☆8Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for MATE
- Resource and Code for ICME 2021 paper "MNRE: A Challenge Multimodal Dataset for Neural Relation Extraction with Visual Evidence in Social…☆50Updated 2 years ago
- A Few-Shot Learning based Approach to Multimodal Social Relation Extraction☆13Updated last year
- KM-BART: Knowledge Enhanced Multimodal BART for Visual Commonsense Generation☆30Updated 3 years ago
- Code for Infusing Multi-Source Knowledge with Heterogeneous Graph Neural Network for Emotional Conversation Generation (AAAI21)☆25Updated 2 years ago
- Code for ACM MM 2021 Paper "Multimodal Relation Extraction with Efficient Graph Alignment".☆90Updated 2 years ago
- ☆16Updated last year
- Multi-modal Graph Fusion for Named Entity Recognition with Targeted Visual Guidance☆65Updated last month
- Code for our EMNLP-2022 paper: "Language Prior Is Not the Only Shortcut: A Benchmark for Shortcut Learning in VQA"☆35Updated 2 years ago
- ☆26Updated 2 years ago
- ☆33Updated last year
- ☆30Updated 4 years ago
- Code for IEEE Trans. on Multimedia (TMM) paper "Object-aware Multimodal Named Entity Recognition in Social Media Posts with Adversarial L…☆16Updated 3 years ago
- ☆12Updated 2 years ago
- [NAACL 2022 Findings] Good Visual Guidance Makes A Better Extractor: Hierarchical Visual Prefix for Multimodal Entity and Relation Extrac…☆98Updated last year
- Multimodal entity linking (MEL) aims to utilize multimodal information to map mentions to corresponding entities defined in knowledge bas…☆80Updated 3 years ago
- ☆56Updated 2 years ago
- RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER☆71Updated last year
- Multimodal entity linking for Tweets☆28Updated 3 years ago
- [Paper][ISWC 2021] Zero-shot Visual Question Answering using Knowledge Graph☆65Updated 9 months ago
- The code for the paper "Neutral Utterances are Also Causes: Enhancing Conversational Causal Emotion Entailment with Social Commonsense Kn…☆27Updated 2 years ago
- This is code for Joint Multimodal Entity-Relation Extraction Based on Edge-enhanced Graph Alignment Network and Word-pair Relation Taggin…☆52Updated 8 months ago
- Code and model for AAAI 2024: UMIE: Unified Multimodal Information Extraction with Instruction Tuning☆29Updated 5 months ago
- Official repository for "MMConv: An Environment for Multimodal Conversational Search across Multiple Domains"☆33Updated 3 years ago
- ☆19Updated 2 years ago
- PyTorch implementation of "Debiased Visual Question Answering from Feature and Sample Perspectives" (NeurIPS 2021)☆22Updated 2 years ago
- ☆19Updated 3 years ago
- A preprocessing and training code for DialogueGCN on Dailydialogue and Mastodon dataset. Use Bert base to preprocess the sentences. Based…☆27Updated 3 years ago
- Code for our ACL2022 paper "Improving Event Representation via Simultaneous Weakly Supervised Contrastive Learning and Clustering".☆28Updated 2 years ago
- Cross-media Structured Common Space for Multimedia Event Extraction (ACL2020)☆69Updated last year
- Multistage Fusion with Forget Gate for Multimodal Summarization in Open-Domain Videos☆11Updated 4 years ago