The codes and datasets about our ACL 2024 Main Conference paper titled "Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge Alignment"
☆17Jan 24, 2025Updated last year
Alternatives and similar repositories for Cognitive-Visual-Language-Mapper
Users that are interested in Cognitive-Visual-Language-Mapper are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project page is about the pytorch code implementation of GlyphBERT by the HITsz-TMG research group.☆11Aug 29, 2022Updated 4 years ago
- ☆16Jul 20, 2023Updated 3 years ago
- ☆29Dec 16, 2022Updated 3 years ago
- Repo for the EMNLP 2023 paper "A Simple Knowledge-Based Visual Question Answering"☆26Dec 14, 2023Updated 2 years ago
- ☆13Sep 24, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆11Mar 11, 2026Updated 8 months ago
- ☆14Apr 28, 2024Updated 2 years ago
- VL-JEPA: Vision-Language Joint Embedding Predictive Architecture implementation in PyTorch☆16Sep 29, 2026Updated last month
- Code for our ACL-2023 paper: "Combo of Thinking and Observing for Outside-Knowledge VQA"☆11Jun 30, 2023Updated 3 years ago
- [Arxiv 2024] Knowledge Acquisition Disentanglement for Knowledge-based Visual Question Answering with Large Language Models☆10Jul 23, 2024Updated 2 years ago
- Implementation for the paper "Unified Multimodal Model with Unlikelihood Training for Visual Dialog"☆13May 12, 2023Updated 3 years ago
- A multimodal context reasoning approach that introduce the multi-view semantic alignment information via prefix tuning.☆16Sep 14, 2023Updated 3 years ago
- ☆13Aug 14, 2022Updated 4 years ago
- The diverse video evaluation benchmark☆15Oct 12, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Source code for paper "VD-PCR: Improving Visual Dialog with Pronoun Coreference Resolution"☆10Nov 1, 2022Updated 4 years ago
- Attaching human-like eyes to the large language model. The codes of IEEE TMM paper "LMEye: An Interactive Perception Network for Large La…☆49Jul 18, 2024Updated 2 years ago
- The implement of Commonsense Knowledge Aware Concept Selection For Diverse and Informative Visual Storytelling☆12Aug 19, 2021Updated 5 years ago
- the code for paper: A Symmetric Dual Encoding Dense Retrieval Framework for Knowledge-Intensive Visual Question Answering☆14Aug 22, 2023Updated 3 years ago
- 🌈 PyTorch Implementation for EMNLP'21 Findings "Reasoning Visual Dialog with Sparse Graph Learning and Knowledge Transfer"☆13Feb 1, 2023Updated 3 years ago
- [ECCV2022] Rethinking Data Augmentation for Robust Visual Question Answering☆12Nov 23, 2022Updated 3 years ago
- Registration-aided 3D Point Cloud Learning for Large-Scale Place Recognition (IROS 2021)☆12May 28, 2022Updated 4 years ago
- CaMML:Context-Aware MultiModal Learner for Large Models (ACL 2024 SAC Award)☆15May 21, 2025Updated last year
- [EMNLP'23 Oral] ReSee: Responding through Seeing Fine-grained Visual Knowledge in Open-domain Dialogue PyTorch Implementation☆12Dec 4, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Possible Worlds VQA: causal visual question answering (IEEE Transactions on Multimedia 2024)☆12Oct 4, 2026Updated last month
- Information Bottleneck in DNN with PyTorch☆15Jul 6, 2023Updated 3 years ago
- ☆17Apr 16, 2025Updated last year
- [ACM MM 2024] See or Guess: Counterfactually Regularized Image Captioning☆16Feb 17, 2025Updated last year
- Official implementation for the MM'22 paper.☆13Jun 30, 2022Updated 4 years ago
- [NAACL 2024] Vision language model that reduces hallucinations through self-feedback guided revision. Visualizes attentions on image feat…☆49Aug 21, 2024Updated 2 years ago
- [NeurIPS'24] Scene Graph Generation with Role-Playing Large Language Models☆15Oct 10, 2025Updated last year
- ☆19Dec 8, 2022Updated 3 years ago
- MuCR is a benchmark designed to evaluate Multimodal Large Language Models' (MLLMs) ability to discern causal links across modalities☆21May 27, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Repository to reproduce the experiments in the paper "Deep learning observables in computational fluid dynamics"☆14Dec 16, 2019Updated 6 years ago
- Papers about the trend of Entity Linking in recent years.☆11Sep 5, 2022Updated 4 years ago
- Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)☆99Oct 19, 2024Updated 2 years ago
- CauSight: Learning to Supersense for Visual Causal Discovery☆22Mar 11, 2026Updated 8 months ago
- About Official PyTorch(MMCV) implementation of “SUMix: Mixup with Semantic and Uncertain Information” (ECCV 2024)☆12Sep 2, 2024Updated 2 years ago
- Github repository for Plot and Rework: Modeling Storylines for Visual Storytelling (ACL-IJCNLP2021 Findings)☆22Aug 22, 2022Updated 4 years ago
- [CVPR 2025] PyTorch implementation of T-CORE, introduced in "When the Future Becomes the Past: Taming Temporal Correspondence for Self-su…☆19Nov 4, 2025Updated last year
Are these results useful?