Alternatives and similar repositories for GPT-4V-Evaluation

Users that are interested in GPT-4V-Evaluation are comparing it to the libraries listed below

• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• junyangwang0410 / HaELM
  An automatic MLLM hallucination detection framework
  ☆19Updated last year
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆75Updated 7 months ago
• lfy79001 / S3Eval
  [NAACL 2024] A Synthetic, Scalable and Systematic Evaluation Suite for Large Language Models
  ☆32Updated last year
• mlfoundations / VisIT-Bench
  ☆50Updated last year
• LightChen233 / M3CoT
  ☆74Updated last year
• lscpku / VITATECS
  ☆18Updated 11 months ago
• ZhangYiqun018 / StickerConv
  ☆51Updated last year
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆44Updated last year
• thunlp / Muffin
  ☆64Updated last year
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆53Updated last year
• AGI-Edgerunners / IIL
  Code for our Paper "All in an Aggregated Image for In-Image Learning"
  ☆30Updated last year
• Aman-4-Real / awesome-multimodal-dialogue
  Paper, dataset and code list for multimodal dialogue.
  ☆21Updated 5 months ago
• CriticBench / CriticBench
  [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning
  ☆26Updated last year
• gyhdog99 / MoCLE
  MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)
  ☆41Updated last year
• RifleZhang / LLaVA-Reasoner-DPO
  ☆80Updated 5 months ago
• xuyige / SoftCoT
  ACL'2025: SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs. and preprint: SoftCoT++: Test-Time Scaling with Soft Chain-of…
  ☆28Updated 3 weeks ago
• FudanDISC / ReForm-Eval
  An benchmark for evaluating the capabilities of large vision-language models (LVLMs)
  ☆46Updated last year
• RainBowLuoCS / DEEM
  (ICLR2025 Spotlight) DEEM: Official implementation of Diffusion models serve as the eyes of large language models for image perception.
  ☆34Updated 3 months ago
• JiwanChung / vlis
  ☆24Updated last year
• findalexli / mllm-dpo
  [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model
  ☆46Updated 7 months ago
• kyegomez / Mirasol
  Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"
  ☆26Updated 5 months ago
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆33Updated last year
• RenShuhuai-Andy / my-tools
  my commonly-used tools
  ☆56Updated 5 months ago
• yaolinli / DeCo
  ☆37Updated 11 months ago
• iwangjian / Midi-Tuning
  Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue (ACL 2024)
  ☆23Updated 10 months ago
• TobiasLee / VEC
  Visual and Embodied Concepts evaluation benchmark
  ☆21Updated last year
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆92Updated 8 months ago
• gzcch / Bingo
  ☆55Updated last year
• FreedomIntelligence / MLLM-Bench
  MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria
  ☆70Updated 8 months ago