AndersonStra / Mucko
implementation for Mucko: Multi-Layer Cross-Modal Knowledge Reasoning for Fact-based Visual Question Answering
☆10Updated 3 years ago
Alternatives and similar repositories for Mucko:
Users that are interested in Mucko are comparing it to the libraries listed below
- [Paper][IJCKG 2022] LaKo: Knowledge-driven Visual Question Answering via Late Knowledge-to-Text Injection☆25Updated last year
- MuKEA: Multimodal Knowledge Extraction and Accumulation for Knowledge-based Visual Question Answering☆93Updated last year
- Official implementation for the MM'22 paper.☆12Updated 2 years ago
- Pytorch Implementation of MUCKO(2020 IJCAI)☆20Updated 4 years ago
- [Paper][ISWC 2021] Zero-shot Visual Question Answering using Knowledge Graph☆70Updated last year
- ☆37Updated 2 years ago
- ☆28Updated 2 years ago
- Code and model for AAAI 2024: UMIE: Unified Multimodal Information Extraction with Instruction Tuning☆34Updated 9 months ago
- ☆20Updated 4 years ago
- PyTorch implementation of "Debiased Visual Question Answering from Feature and Sample Perspectives" (NeurIPS 2021)☆25Updated 2 years ago
- Code for our EMNLP-2022 paper: "Language Prior Is Not the Only Shortcut: A Benchmark for Shortcut Learning in VQA"☆38Updated 2 years ago
- ☆34Updated 2 years ago
- Implementation of Mutan+ArticleNet on OKVQA☆10Updated 4 years ago
- Recent Advances in Visual Dialog☆30Updated 2 years ago
- the implementation of EMNLP 2020 "Learning to Contrast the Counterfactual Samples for Robust Visual Question Answering"☆14Updated 3 years ago
- Multi-modal Graph Fusion for Named Entity Recognition with Targeted Visual Guidance☆66Updated 5 months ago
- About Codes for ACL 2023 paper: Exploiting! Multimodal Relation Extraction with Feature Denoising and Multimodal Topic Modeling.☆16Updated 8 months ago
- The code of IJCAI2022 paper, Declaration-based Prompt Tuning for Visual Question Answering☆19Updated 2 years ago
- ☆101Updated 2 years ago
- Resource and Code for ICME 2021 paper "MNRE: A Challenge Multimodal Dataset for Neural Relation Extraction with Visual Evidence in Social…☆53Updated 3 years ago
- Code for our ACL2021 paper: "Check It Again: Progressive Visual Question Answering via Visual Entailment"☆31Updated 3 years ago
- the code for paper: A Symmetric Dual Encoding Dense Retrieval Framework for Knowledge-Intensive Visual Question Answering☆12Updated last year
- Cross-media Structured Common Space for Multimedia Event Extraction (ACL2020)☆71Updated last year
- Code for our IJCAI2020 paper: Overcoming Language Priors with Self-supervised Learning for Visual Question Answering☆50Updated 4 years ago
- Code for IEEE Trans. on Multimedia (TMM) paper "Object-aware Multimodal Named Entity Recognition in Social Media Posts with Adversarial L…☆16Updated 4 years ago
- GraphVQA: Language-Guided Graph Neural Networks for Scene Graph Question Answering☆62Updated 3 years ago
- This is code for Joint Multimodal Entity-Relation Extraction Based on Edge-enhanced Graph Alignment Network and Word-pair Relation Taggin…☆56Updated last year
- ☆20Updated 11 months ago
- [NAACL 2022 Findings] Good Visual Guidance Makes A Better Extractor: Hierarchical Visual Prefix for Multimodal Entity and Relation Extrac…☆108Updated this week
- A Few-Shot Learning based Approach to Multimodal Social Relation Extraction☆13Updated 2 years ago