Alternatives and similar repositories for MixEval-X:

Users that are interested in MixEval-X are comparing it to the libraries listed below

• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆42Updated 2 months ago
• jdf-prog / LLM-Engines
  ☆44Updated last week
• LgQu / TIGeR
  Code for paper: Unified Text-to-Image Generation and Retrieval
  ☆15Updated 10 months ago
• NuoJohnChen / JudgeLRM
  ☆24Updated 3 weeks ago
• yale-nlp / refdpo
  ☆16Updated 9 months ago
• HanSolo9682 / CounterCurate
  This is the implementation of CounterCurate, the data curation pipeline of both physical and semantic counterfactual image-caption pairs.
  ☆18Updated 10 months ago
• TIGER-AI-Lab / VISTA
  The code for "VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by VIdeo SpatioTemporal Augmentation" [CVPR2025]
  ☆15Updated 2 months ago
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆12Updated 10 months ago
• aszala / VPEval
  VPEval Codebase from Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆44Updated last year
• Wang-ML-Lab / multimodal-needle-in-a-haystack
  [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models
  ☆42Updated last week
• MLLM-Data-Contamination / MM-Detect
  This repo contains code for the paper "Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM"
  ☆13Updated last month
• DAMO-NLP-SG / LongPO
  [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
  ☆35Updated 2 months ago
• MIO-Team / MIO
  MIO: A Foundation Model on Multimodal Tokens
  ☆25Updated 4 months ago
• apple / ml-mia-bench
  This repo contains code and data for ICLR 2025 paper MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMs
  ☆31Updated last month
• passing2961 / Stark
  Official code and dataset for our EMNLP 2024 Findings paper: Stark: Social Long-Term Multi-Modal Conversation with Persona Commonsense Kn…
  ☆19Updated 4 months ago
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆44Updated 5 months ago
• liziniu / cold_start_rl
  Code for Blog Post: Can Better Cold-Start Strategies Improve RL Training for LLMs?
  ☆16Updated last month
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆55Updated 3 weeks ago
• jylei16 / Imagine-e
  ☆10Updated 3 months ago
• MikeWangWZHL / dymu
  ☆10Updated last week
• McGill-NLP / AURORA
  Code and data for the paper: Learning Action and Reasoning-Centric Image Editing from Videos and Simulation
  ☆28Updated 3 months ago
• kyegomez / KosmosG
  My implementation of the model KosmosG from "KOSMOS-G: Generating Images in Context with Multimodal Large Language Models"
  ☆14Updated 5 months ago
• chenllliang / MMEvalPro
  [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs
  ☆24Updated 7 months ago
• Qichuzyy / POA
  Official implementation of ECCV24 paper: POA
  ☆24Updated 8 months ago
• Picsart-AI-Research / Social-Reward
  ☆10Updated last year
• chenllliang / DnD-Transformer
  [ICLR 2025] Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegr…
  ☆75Updated 4 months ago
• UCSC-VLAA / Sight-Beyond-Text
  [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
  ☆19Updated last year
• princeton-nlp / ELIZA-Transformer
  [NAACL 2025] Representing Rule-based Chatbots with Transformers
  ☆20Updated 2 months ago
• TIGER-AI-Lab / VisualWebInstruct
  The official repo for "VisualWebInstruct: Scaling up Multimodal Instruction Data through Web Search"
  ☆24Updated this week
• MJ-Bench / MJ-Bench
  Official implementation for "MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?"
  ☆43Updated 2 months ago