YunxinLi / Multimodal-Context-Reasoning
A multimodal context reasoning approach that introduce the multi-view semantic alignment information via prefix tuning.
☆16Updated last year
Alternatives and similar repositories for Multimodal-Context-Reasoning:
Users that are interested in Multimodal-Context-Reasoning are comparing it to the libraries listed below
- An Easy-to-use Hallucination Detection Framework for LLMs.☆55Updated 9 months ago
- Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement (EMNLP 2024 Main Conference)☆50Updated 3 months ago
- The repository for ACL 2024 paper "TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language Models"☆27Updated 7 months ago
- ☆59Updated 7 months ago
- [NAACL 2024] A Synthetic, Scalable and Systematic Evaluation Suite for Large Language Models☆33Updated 7 months ago
- Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."☆39Updated 3 months ago
- ☆37Updated 2 months ago
- ☆49Updated 3 months ago
- An benchmark for evaluating the capabilities of large vision-language models (LVLMs)☆43Updated last year
- Code for the paper <SelfCheck: Using LLMs to Zero-Shot Check Their Own Step-by-Step Reasoning>☆48Updated last year
- [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Models☆141Updated 9 months ago
- In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)☆50Updated 10 months ago
- [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"☆64Updated 9 months ago
- ChartMimic: Evaluating LMM’s Cross-Modal Reasoning Capability via Chart-to-Code Generation☆96Updated 6 months ago
- ☆39Updated 3 months ago
- [ICLR 2023] Multimodal Analogical Reasoning over Knowledge Graphs☆108Updated 6 months ago
- Unofficial Implementation of Chain-of-Thought Reasoning Without Prompting☆26Updated 10 months ago
- ☆58Updated 4 months ago
- Official Code of IdealGPT☆34Updated last year
- Data for evaluating GPT-4V☆11Updated last year
- Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations"☆53Updated this week
- [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.☆59Updated 2 months ago
- Code and model for AAAI 2024: UMIE: Unified Multimodal Information Extraction with Instruction Tuning☆30Updated 7 months ago
- ☆18Updated 6 months ago
- Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073☆26Updated 6 months ago
- code for EMNLP 2024 paper: Neuron-Level Knowledge Attribution in Large Language Models☆26Updated 2 months ago
- Paper collections of methods that using language to interact with environment, including interact with real world, simulated world or WWW…☆124Updated last year
- Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"☆62Updated 2 years ago
- ☆16Updated last year