Alternatives and similar repositories for MULTI-Benchmark:

Users that are interested in MULTI-Benchmark are comparing it to the libraries listed below

• findalexli / mllm-dpo
  [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model
  ☆32Updated 2 months ago
• pipilurj / bootstrapped-preference-optimization-BPO
  code for "Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization"
  ☆53Updated 4 months ago
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆67Updated last month
• njucckevin / MM-Self-Improve
  A Self-Training Framework for Vision-Language Reasoning
  ☆60Updated 2 months ago
• MAmmoTH-VL / MAmmoTH-VL
  MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale
  ☆28Updated last month
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆40Updated 6 months ago
• FudanDISC / ReForm-Eval
  An benchmark for evaluating the capabilities of large vision-language models (LVLMs)
  ☆42Updated last year
• RupertLuo / VoCoT
  VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models
  ☆40Updated 6 months ago
• mlfoundations / VisIT-Bench
  ☆47Updated last year
• Cooperx521 / PyramidDrop
  The official code of the paper "PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction".
  ☆51Updated last week
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆32Updated last year
• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆40Updated 9 months ago
• HiThink-Research / MME-Finance
  ☆27Updated last week
• pipilurj / G-LLaVA
  Official github repo of G-LLaVA
  ☆122Updated 7 months ago
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆54Updated last month
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆62Updated 7 months ago
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆56Updated 3 months ago
• weigq / iclr2023_stats
  ICLR2023 statistics
  ☆60Updated last year
• Liuziyu77 / MIA-DPO
  Official implement of MIA-DPO
  ☆49Updated 2 months ago
• gzcch / Bingo
  ☆54Updated 9 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆82Updated 3 months ago
• 1zhou-Wang / MemVR
  Official implementation of paper 'Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in Multimodal …
  ☆38Updated last month
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆25Updated 6 months ago
• sail-sg / Attention-Sink
  [ATTRIB @ NeurIPS 2024 Oral] When Attention Sink Emerges in Language Models: An Empirical View
  ☆43Updated 3 months ago
• LINs-lab / DynMoE
  [Preprint] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
  ☆59Updated 4 months ago
• si0wang / VisVM
  ☆31Updated 3 weeks ago
• OpenGVLab / V2PE
  [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding
  ☆24Updated last month
• LightChen233 / M3CoT
  ☆58Updated 7 months ago
• sail-sg / MMCBench
  ☆27Updated 11 months ago