flageval-baai / CMMU

Related projects ⓘ

Alternatives and complementary repositories for CMMU

• Alibaba-NLP / OmniSearch
  Repo for Benchmarking Multimodal Retrieval Augmented Generation with Dynamic VQA Dataset and Self-adaptive Planning Agent
  ☆66Updated this week
• VectorSpaceLab / Video-XL
  🔥🔥First-ever hour scale video understanding models
  ☆169Updated 3 weeks ago
• FudanNLPLAB / MouSi
  ☆74Updated 8 months ago
• open-compass / MMBench
  Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"
  ☆163Updated 2 months ago
• LaVi-Lab / CLEVA
  [EMNLP 2023 Demo] CLEVA: Chinese Language Models EVAluation Platform
  ☆57Updated 11 months ago
• FlagOpen / Infinity-Instruct
  ☆40Updated 5 months ago
• westlake-baichuan-mllm / bc-omni
  Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊
  ☆236Updated 3 weeks ago
• RLHF-V / RLHF-V
  [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback
  ☆235Updated 2 months ago
• FreedomIntelligence / ALLaVA
  Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model
  ☆246Updated 4 months ago
• codefuse-ai / CodeFuse-MFT-VLM
  ☆34Updated last month
• RLHF-V / RLAIF-V
  RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthiness
  ☆246Updated 2 weeks ago
• LinWeizheDragon / FLMR
  The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.
  ☆69Updated 2 months ago
• YanqiDai / MMRole
  A Comprehensive Framework for Developing and Evaluating Multimodal Role-Playing Agents
  ☆31Updated this week
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆126Updated 5 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆75Updated last month
• OpenGVLab / MM-NIAH
  [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…
  ☆102Updated last month
• THUDM / CogCoM
  ☆152Updated 4 months ago
• FreedomIntelligence / MLLM-Bench
  MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria
  ☆55Updated last month
• sterzhang / image-textualization
  Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions (NeurIPS 2024)
  ☆145Updated 3 months ago
• MM-LLMs / mm-llms.github.io
  ☆26Updated 7 months ago
• patrick-tssn / Awesome-Colorful-LLM
  Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics,…
  ☆113Updated last month
• princeton-nlp / CharXiv
  [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
  ☆75Updated last month
• HaozheZhao / MIC
  MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU
  ☆334Updated 11 months ago
• OpenGVLab / MMT-Bench
  ICML'2024 | MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI
  ☆95Updated 4 months ago
• bytedance / lynx-llm
  paper: https://arxiv.org/abs/2307.02469 page: https://lynx-llm.github.io/
  ☆229Updated last year
• X-PLUG / Multi-LLM-Agent
  ☆194Updated 6 months ago
• Alpha-VLLM / WeMix-LLM
  ☆17Updated last year
• GAIR-NLP / ProX
  Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"
  ☆191Updated last month
• LinWeizheDragon / Retrieval-Augmented-Visual-Question-Answering
  This is the official repository for Retrieval Augmented Visual Question Answering
  ☆182Updated 2 months ago
• open-compass / BotChat
  Evaluating LLMs' multi-round chatting capability via assessing conversations generated by two LLM instances.
  ☆139Updated last year