Alternatives and similar repositories for Multi-modal-Self-instruct:

Users that are interested in Multi-modal-Self-instruct are comparing it to the libraries listed below

• vlf-silkie / VLFeedback
  ☆94Updated last year
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆56Updated last year
• OpenGVLab / MMIU
  MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
  ☆58Updated 4 months ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆62Updated 7 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆80Updated 3 months ago
• RupertLuo / VoCoT
  VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models
  ☆40Updated 6 months ago
• Liuziyu77 / MIA-DPO
  Official implement of MIA-DPO
  ☆49Updated 2 months ago
• DAMO-NLP-SG / multimodal_textbook
  The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"
  ☆117Updated last week
• findalexli / mllm-dpo
  [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model
  ☆32Updated 2 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆49Updated last week
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆43Updated 2 weeks ago
• MAmmoTH-VL / MAmmoTH-VL
  MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale
  ☆27Updated last month
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆24Updated 6 months ago
• RUCAIBox / ComVint
  The official GitHub page for ''What Makes for Good Visual Instructions? Synthesizing Complex Visual Reasoning Instructions for Visual Ins…
  ☆18Updated last year
• foundation-multimodal-models / CAPTURE
  ☆42Updated 5 months ago
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆43Updated 6 months ago
• Cooperx521 / PyramidDrop
  The official code of the paper "PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction".
  ☆50Updated last week
• palchenli / VL-Instruction-Tuning
  ☆87Updated last year
• pengts / VW-LMM
  ☆24Updated 8 months ago
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆56Updated 4 months ago
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆33Updated 2 months ago
• thunlp / Muffin
  ☆59Updated 11 months ago
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆60Updated 7 months ago
• ParadoxZW / LLaVA-UHD-Better
  A bug-free and improved implementation of LLaVA-UHD, based on the code from the official repo
  ☆32Updated 5 months ago
• si0wang / VisVM
  ☆31Updated 2 weeks ago
• yaolinli / DeCo
  ☆25Updated 6 months ago
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆56Updated 3 months ago
• Share14 / ShareGemini
  ☆26Updated 5 months ago
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆55Updated 2 months ago
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆68Updated this week