MMMU-Benchmark / MMMU

Related projects: ⓘ

• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆252Updated 3 weeks ago
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆303Updated 2 months ago
• TIGER-AI-Lab / Mantis
  Official code for Paper "Mantis: Multi-Image Instruction Tuning"
  ☆157Updated last week
• lupantech / MathVista
  MathVista: data, code, and evaluation for Mathematical Reasoning in Visual Contexts
  ☆219Updated this week
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆293Updated 3 weeks ago
• tianyi-lab / HallusionBench
  [CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(…
  ☆220Updated 6 months ago
• njucckevin / SeeClick
  The model, data and code for the visual GUI Agent SeeClick
  ☆182Updated 3 weeks ago
• RLHF-V / RLAIF-V
  RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthiness
  ☆200Updated last week
• FuxiaoLiu / LRV-Instruction
  [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
  ☆244Updated 6 months ago
• open-compass / MMBench
  Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"
  ☆142Updated 2 weeks ago
• for-ai / parameter-efficient-moe
  ☆239Updated 10 months ago
• RLHF-V / RLHF-V
  [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback
  ☆218Updated last week
• pkunlp-icler / FastV
  [ECCV 2024] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Mo…
  ☆207Updated last month
• RunpeiDong / DreamLLM
  [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation
  ☆378Updated 5 months ago
• FreedomIntelligence / ALLaVA
  Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model
  ☆237Updated 2 months ago
• llava-rlhf / LLaVA-RLHF
  Aligning LMMs with Factually Augmented RLHF
  ☆302Updated 10 months ago
• thunlp / LLaVA-UHD
  LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images
  ☆298Updated last month
• OpenGVLab / Multi-Modality-Arena
  Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing imag…
  ☆441Updated 4 months ago
• HaozheZhao / MIC
  MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU
  ☆321Updated 9 months ago
• OpenGVLab / LAMM
  [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents
  ☆297Updated 5 months ago
• QwenLM / AutoIF
  ☆185Updated last month
• h-zhao1997 / cobra
  Cobra: Extending Mamba to Multi-modal Large Language Model for Efficient Inference
  ☆240Updated last month
• HyperGAI / HPT
  HPT - Open Multimodal LLMs from HyperGAI
  ☆309Updated 3 months ago
• TencentARC / LLaMA-Pro
  [ACL 2024] Progressive LLaMA with Block Expansion.
  ☆464Updated 3 months ago
• microsoft / simulated-trial-and-error
  ☆111Updated 3 months ago
• showlab / Awesome-GUI-Agent
  💻 A curated list of papers and resources for multi-modal Graphical User Interface (GUI) agents.
  ☆122Updated this week
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆290Updated 5 months ago
• kongds / E5-V
  E5-V: Universal Embeddings with Multimodal Large Language Models
  ☆148Updated 2 months ago
• voidism / DoLa
  Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"
  ☆405Updated 4 months ago
• OpenGVLab / ControlLLM
  ControlLLM: Augment Language Models with Tools by Searching on Graphs
  ☆183Updated 2 months ago