UMass-Embodied-AGI / VisualCoT
Codebase for AAAI 2024 conference paper Visual Chain-of-Thought Prompting for Knowledge-based Visual Reasoning
☆28Updated 3 weeks ago
Alternatives and similar repositories for VisualCoT:
Users that are interested in VisualCoT are comparing it to the libraries listed below
- MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU☆47Updated last year
- Source code for EMNLP 2022 paper “PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models”☆48Updated 2 years ago
- ☆11Updated 9 months ago
- Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models☆37Updated last year
- Official repository for the A-OKVQA dataset☆81Updated 10 months ago
- ☆66Updated 6 years ago
- This repo contains code for Invariant Grounding for Video Question Answering☆27Updated 2 years ago
- [NeurIPS 2023]DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Models☆41Updated last year
- HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)☆44Updated 8 months ago
- Colorful Prompt Tuning for Pre-trained Vision-Language Models☆49Updated 2 years ago
- ☆20Updated 2 years ago
- ☆67Updated last year
- Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization☆86Updated last year
- Official Repository for CVPR 2022 paper "REX: Reasoning-aware and Grounded Explanation"☆21Updated last year
- ✨A curated list of papers on the uncertainty in multi-modal large language model (MLLM).☆39Updated last week
- [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"☆53Updated last year
- [ICML2024] Repo for the paper `Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models'☆20Updated 3 months ago
- 🔎Official code for our paper: "VL-Uncertainty: Detecting Hallucination in Large Vision-Language Model via Uncertainty Estimation".☆30Updated 2 weeks ago
- This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…☆77Updated last month
- ☆28Updated 2 years ago
- [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Models☆145Updated 11 months ago
- VQACL: A Novel Visual Question Answering Continual Learning Setting (CVPR'23)☆35Updated last year
- ☆43Updated last year
- ICCV 2023 (Oral) Open-domain Visual Entity Recognition Towards Recognizing Millions of Wikipedia Entities☆38Updated 7 months ago
- Counterfactual Reasoning VQA Dataset☆24Updated last year
- (ICML 2024) Improve Context Understanding in Multimodal Large Language Models via Multimodal Composition Learning☆28Updated 6 months ago
- This is the official repository for the paper "Visually-Prompted Language Model for Fine-Grained Scene Graph Generation in an Open World"…☆47Updated last year
- NegCLIP.☆32Updated 2 years ago
- ☆28Updated 3 weeks ago
- Official Code of IdealGPT☆34Updated last year