Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"
☆69Jul 11, 2022Updated 3 years ago
Alternatives and similar repositories for KAT
Users that are interested in KAT are comparing it to the libraries listed below
Sorting:
- [Paper][IJCKG 2022] LaKo: Knowledge-driven Visual Question Answering via Late Knowledge-to-Text Injection☆25Feb 9, 2024Updated 2 years ago
- Official implementation for the MM'22 paper.☆14Jun 30, 2022Updated 3 years ago
- Code for our ACL-2023 paper: "Combo of Thinking and Observing for Outside-Knowledge VQA"☆12Jun 30, 2023Updated 2 years ago
- MuKEA: Multimodal Knowledge Extraction and Accumulation for Knowledge-based Visual Question Answering☆100Mar 30, 2023Updated 2 years ago
- the code for paper: A Symmetric Dual Encoding Dense Retrieval Framework for Knowledge-Intensive Visual Question Answering☆13Aug 22, 2023Updated 2 years ago
- ☆18Dec 8, 2022Updated 3 years ago
- [NeurIPS 2022] Official code for REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering☆105Apr 6, 2025Updated 10 months ago
- Implementation of ConceptBert: Concept-Aware Representation for Visual Question Answering☆31Apr 30, 2024Updated last year
- This is the official repository for Retrieval Augmented Visual Question Answering☆244Dec 19, 2024Updated last year
- Implementation of CVPR 2023 paper "Prompting Large Language Models with Answer Heuristics for Knowledge-based Visual Question Answering".☆278Jun 14, 2025Updated 8 months ago
- ☆68Oct 27, 2023Updated 2 years ago
- An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA, AAAI 2022 (Oral)☆87Apr 10, 2022Updated 3 years ago
- Download Web-10K data by querying Bing Image Search☆10Feb 1, 2022Updated 4 years ago
- ☆12Jun 18, 2024Updated last year
- A collections of papers about VQA-CP datasets and their results☆41Mar 18, 2022Updated 3 years ago
- a multimodal retrieval dataset☆24Jul 8, 2023Updated 2 years ago
- code for learning trajectory dependencies for human motion prediction☆11Mar 2, 2022Updated 4 years ago
- Visual Dialog: Light-weight Transformer for Many Inputs (ECCV 2020)☆29Aug 5, 2021Updated 4 years ago
- This repo includes our code for evaluating and improving transferability in domain generalization (NeurIPS 2021)☆13Nov 1, 2022Updated 3 years ago
- PyTorch DataLoader for many VQA datasets☆14Jan 10, 2023Updated 3 years ago
- ☆14May 10, 2021Updated 4 years ago
- ☆13May 9, 2023Updated 2 years ago
- ☆13Feb 14, 2022Updated 4 years ago
- Code for Navigating Connected Memories with a Task-oriented Dialog System☆17Dec 12, 2022Updated 3 years ago
- ☆16May 23, 2023Updated 2 years ago
- [ICML 2022] This is the pytorch implementation of "Rethinking Attention-Model Explainability through Faithfulness Violation Test" (https:…☆20Jul 21, 2022Updated 3 years ago
- 500 visa dashboard☆34Aug 13, 2025Updated 6 months ago
- We introduce new approach, Token Reduction using CLIP Metric (TRIM), aimed at improving the efficiency of MLLMs without sacrificing their…☆20Jan 11, 2026Updated last month
- ☆67Jun 18, 2023Updated 2 years ago
- AIR-Bench 2024 is a safety benchmark that aligns with emerging government regulations and company policies☆28Aug 14, 2024Updated last year
- ☆24Mar 1, 2025Updated last year
- ☆19Feb 8, 2024Updated 2 years ago
- ☆19Oct 27, 2025Updated 4 months ago
- An official codebase for paper " CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"☆52Aug 13, 2023Updated 2 years ago
- Implementation of the model: "(MC-ViT)" from the paper: "Memory Consolidation Enables Long-Context Video Understanding"☆27Jan 17, 2026Updated last month
- Unified Representations of Structured and Unstructured Knowledge for Open-Domain Question Answering☆50Aug 2, 2022Updated 3 years ago
- [ECCV'22 Poster] Explicit Image Caption Editing☆22Nov 30, 2022Updated 3 years ago
- rmp data ranking☆13Nov 4, 2025Updated 3 months ago
- Official implementation for "Parameter-Efficient Fine-Tuning Design Spaces"☆27Jan 4, 2023Updated 3 years ago