Alternatives and similar repositories for Multimodal-Context-Reasoning

Users that are interested in Multimodal-Context-Reasoning are comparing it to the libraries listed below

• ZUCC-AI / UMIE
  Code and model for AAAI 2024: UMIE: Unified Multimodal Information Extraction with Instruction Tuning
  ☆40Updated last year
• OpenKG-ORG / EasyDetect
  An Easy-to-use Hallucination Detection Framework for LLMs.
  ☆62Updated last year
• LightChen233 / M3CoT
  ☆82Updated last year
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆81Updated 10 months ago
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆25Updated last year
• AlignGPT-VL / AlignGPT
  Official repo for "AlignGPT: Multi-modal Large Language Models with Adaptive Alignment Capability"
  ☆33Updated last year
• cathyxl / MAgIC
  ☆41Updated 10 months ago
• JetRunner / SuperICL
  Code for "Small Models are Valuable Plug-ins for Large Language Models"
  ☆131Updated 2 years ago
• Gary-code / KECVQG
  [ACM MM 2023] The released code of paper "Deconfounded Visual Question Generation with Causal Inference"
  ☆10Updated last year
• yuezih / less-is-more
  Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)
  ☆55Updated 11 months ago
• YiyangZhou / LURE
  [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Models
  ☆150Updated last year
• albertwy / GPT-4V-Evaluation
  Data for evaluating GPT-4V
  ☆11Updated last year
• zefang-liu / AdaMoLE
  AdaMoLE: Adaptive Mixture of LoRA Experts
  ☆36Updated 11 months ago
• open-vision-language / infoseek
  ☆64Updated last year
• lezhang7 / MOQAGPT
  [EMNLP'2023 Findings] MoqaGPT, for zero-shot multimodal question answering with LLMs
  ☆13Updated 9 months ago
• allenai / aokvqa
  Official repository for the A-OKVQA dataset
  ☆99Updated last year
• ChartMimic / ChartMimic
  [ICLR 2025] ChartMimic: Evaluating LMM’s Cross-Modal Reasoning Capability via Chart-to-Code Generation
  ☆123Updated 3 months ago
• hkust-nlp / Activation_Decoding
  In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)
  ☆61Updated last year
• xieyuquanxx / awesome-Large-MultiModal-Hallucination
  😎 curated list of awesome LMM hallucinations papers, methods & resources.
  ☆149Updated last year
• VLKEB / VLKEB
  ☆58Updated 11 months ago
• RUCAIBox / POPE
  The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆225Updated last month
• SihengLi99 / LLM-Honesty-Survey
  [2025-TMLR] A Survey on the Honesty of Large Language Models
  ☆59Updated 9 months ago
• PLUM-Lab / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆135Updated 2 years ago
• X-PLUG / mPLUG-HalOwl
  mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating
  ☆98Updated last year
• ShiZhengyan / DePT
  [ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
  ☆96Updated last year
• nusnlp / FSPO
  Official code for our paper "The Hallucination Dilemma: Factuality-Aware Reinforcement Learning for Large Reasoning Models"
  ☆15Updated 4 months ago
• RenShuhuai-Andy / my-tools
  my commonly-used tools
  ☆61Updated 8 months ago
• TIGER-AI-Lab / UniIR
  Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)
  ☆166Updated last year
• patrick-tssn / Awesome-Colorful-LLM
  Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics,…
  ☆123Updated 4 months ago
• gyhdog99 / MoCLE
  MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)
  ☆43Updated 3 months ago