YunxinLi / Multimodal-Context-Reasoning
A multimodal context reasoning approach that introduce the multi-view semantic alignment information via prefix tuning.
☆16Updated last year
Alternatives and similar repositories for Multimodal-Context-Reasoning:
Users that are interested in Multimodal-Context-Reasoning are comparing it to the libraries listed below
- An Easy-to-use Hallucination Detection Framework for LLMs.☆58Updated 11 months ago
- ☆39Updated 4 months ago
- A framework for evolving and testing question-answering datasets with various models.☆14Updated last year
- [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.☆70Updated 4 months ago
- ☆51Updated 5 months ago
- Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations" (ICLR '25)☆63Updated 3 weeks ago
- MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning☆136Updated last year
- ☆66Updated 9 months ago
- An benchmark for evaluating the capabilities of large vision-language models (LVLMs)☆46Updated last year
- ChartMimic: Evaluating LMM’s Cross-Modal Reasoning Capability via Chart-to-Code Generation☆104Updated 8 months ago
- Official repository for the A-OKVQA dataset☆80Updated 10 months ago
- [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Models☆145Updated 11 months ago
- ☆43Updated last year
- Data for evaluating GPT-4V☆11Updated last year
- Code and model for AAAI 2024: UMIE: Unified Multimodal Information Extraction with Instruction Tuning☆34Updated 9 months ago
- The official GitHub page for paper "NegativePrompt: Leveraging Psychology for Large Language Models Enhancement via Negative Emotional St…☆21Updated 10 months ago
- The repository for ACL 2024 paper "TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language Models"☆30Updated 9 months ago
- Official Code of IdealGPT☆34Updated last year
- Enhancing Large Vision Language Models with Self-Training on Image Comprehension.☆65Updated 10 months ago
- Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."☆42Updated 5 months ago
- Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models☆81Updated 9 months ago
- Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"☆63Updated 2 years ago
- Official repo for "AlignGPT: Multi-modal Large Language Models with Adaptive Alignment Capability"☆32Updated 8 months ago
- [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning☆81Updated 11 months ago
- EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions☆20Updated 10 months ago
- ✨ Resolving Knowledge Conflicts in Large Language Models, COLM 2024☆15Updated 6 months ago
- ChatBridge, an approach to learning a unified multimodal model to interpret, correlate, and reason about various modalities without rely…☆50Updated last year
- ☆11Updated 2 weeks ago
- Code for "Small Models are Valuable Plug-ins for Large Language Models"☆129Updated last year
- ☆34Updated last year