Alternatives and similar repositories for MMFM-Challenge

Users that are interested in MMFM-Challenge are comparing it to the libraries listed below

• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆52Updated 6 months ago
• yfzhang114 / LLaVA-Align
  This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…
  ☆78Updated 3 months ago
• mlfoundations / VisIT-Bench
  ☆51Updated last year
• AtsuMiyai / UPD
  [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models
  ☆77Updated last week
• X2FD / LVIS-INSTRUCT4V
  ☆133Updated last year
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆68Updated last year
• opendatalab / HA-DPO
  Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization
  ☆88Updated last year
• hendryx-scale / mhal-detect
  M-HalDetect Dataset Release
  ☆25Updated last year
• pengts / VW-LMM
  ☆25Updated last year
• yeezhu / UNIT
  PyTorch implementation of "UNIT: Unifying Image and Text Recognition in One Vision Encoder", NeurlPS 2024.
  ☆30Updated 8 months ago
• palchenli / VL-Instruction-Tuning
  ☆91Updated last year
• AoiDragon / POPE
  [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆84Updated last year
• BAAI-DCAI / Dataset-Pruning
  Dataset pruning for ImageNet and LAION-2B.
  ☆79Updated 11 months ago
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆86Updated last year
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated last year
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆74Updated 6 months ago
• amazon-science / QA-ViT
  ☆65Updated 10 months ago
• keio-smilab24 / Polos
  [CVPR24 Highlights] Polos: Multimodal Metric Learning from Human Feedback for Image Captioning
  ☆30Updated last week
• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆125Updated 11 months ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆107Updated 4 months ago
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆74Updated 11 months ago
• ys-zong / VL-ICL
  [ICLR 2025] VL-ICL Bench: The Devil in the Details of Multimodal In-Context Learning
  ☆56Updated 4 months ago
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆45Updated 10 months ago
• Computer-Vision-in-the-Wild / Elevater_Toolkit_IC
  Toolkit for Elevater Benchmark
  ☆72Updated last year
• vishaal27 / SuS-X
  Code for the paper: "SuS-X: Training-Free Name-Only Transfer of Vision-Language Models" [ICCV'23]
  ☆101Updated last year
• SivanDoveh / TSVLC
  Repository for the paper: Teaching Structured Vision & Language Concepts to Vision & Language Models
  ☆46Updated last year
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆30Updated 2 months ago
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆44Updated 11 months ago
• allenai / close
  ☆59Updated last year
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆78Updated 4 months ago