AndersonStra / Mucko
implementation for Mucko: Multi-Layer Cross-Modal Knowledge Reasoning for Fact-based Visual Question Answering
☆10Updated 3 years ago
Alternatives and similar repositories for Mucko:
Users that are interested in Mucko are comparing it to the libraries listed below
- Pytorch Implementation of MUCKO(2020 IJCAI)☆20Updated 4 years ago
- [Paper][ISWC 2021] Zero-shot Visual Question Answering using Knowledge Graph☆71Updated last year
- [Paper][IJCKG 2022] LaKo: Knowledge-driven Visual Question Answering via Late Knowledge-to-Text Injection☆26Updated last year
- Code and model for AAAI 2024: UMIE: Unified Multimodal Information Extraction with Instruction Tuning☆34Updated 11 months ago
- Official implementation for the MM'22 paper.☆12Updated 2 years ago
- ☆39Updated 2 years ago
- ☆28Updated 2 years ago
- MuKEA: Multimodal Knowledge Extraction and Accumulation for Knowledge-based Visual Question Answering☆94Updated 2 years ago
- ☆35Updated 2 years ago
- PyTorch implementation of "Debiased Visual Question Answering from Feature and Sample Perspectives" (NeurIPS 2021)☆25Updated 2 years ago
- [ACL 2024 Findings] LLMs as Bridges: Reformulating Grounded Multimodal Named Entity Recognition☆29Updated last month
- ☆20Updated 4 years ago
- Implementation of Mutan+ArticleNet on OKVQA☆10Updated 4 years ago
- Recent Advances in Visual Dialog☆30Updated 2 years ago
- GraphVQA: Language-Guided Graph Neural Networks for Scene Graph Question Answering☆65Updated 3 years ago
- ☆102Updated 3 years ago
- This is code for Joint Multimodal Entity-Relation Extraction Based on Edge-enhanced Graph Alignment Network and Word-pair Relation Taggin…☆57Updated last year
- Code for our IJCAI2020 paper: Overcoming Language Priors with Self-supervised Learning for Visual Question Answering☆50Updated 4 years ago
- Repository for VisualSem: a high-quality knowledge graph to support research in vision and language.☆88Updated 2 years ago
- The code of IJCAI2022 paper, Declaration-based Prompt Tuning for Visual Question Answering☆19Updated 3 years ago
- the implementation of EMNLP 2020 "Learning to Contrast the Counterfactual Samples for Robust Visual Question Answering"☆15Updated 3 years ago
- Implementation for the paper "Unified Multimodal Model with Unlikelihood Training for Visual Dialog"☆13Updated last year
- Code for our ACL2021 paper: "Check It Again: Progressive Visual Question Answering via Visual Entailment"☆31Updated 3 years ago
- Code for ACM MM 2021 Paper "Multimodal Relation Extraction with Efficient Graph Alignment".☆97Updated 2 years ago
- [NAACL 2022 Findings] Good Visual Guidance Makes A Better Extractor: Hierarchical Visual Prefix for Multimodal Entity and Relation Extrac…☆110Updated last month
- Code for our EMNLP-2022 paper: "Language Prior Is Not the Only Shortcut: A Benchmark for Shortcut Learning in VQA"☆39Updated 2 years ago
- the code for paper: A Symmetric Dual Encoding Dense Retrieval Framework for Knowledge-Intensive Visual Question Answering☆12Updated last year
- Resource and Code for ICME 2021 paper "MNRE: A Challenge Multimodal Dataset for Neural Relation Extraction with Visual Evidence in Social…☆55Updated 3 years ago
- Rich Visual Knowledge-based AugmentationNetwork for Visual Question Answering☆10Updated 5 years ago
- [ACMMM 2022] Learning from Different text-image Pairs: A Relation-enhanced Graph Convolutional Network for Multimodal NER☆17Updated 2 years ago