Alternatives and similar repositories for MixEval-X

Users that are interested in MixEval-X are comparing it to the libraries listed below

• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆44Updated 3 months ago
• yale-nlp / refdpo
  ☆16Updated 11 months ago
• jdf-prog / LLM-Engines
  ☆48Updated 2 weeks ago
• apple / ml-mia-bench
  This repo contains code and data for ICLR 2025 paper MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMs
  ☆31Updated 3 months ago
• MLLM-Data-Contamination / MM-Detect
  This repo contains code for the paper "Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM"
  ☆14Updated 2 months ago
• passing2961 / Stark
  Official code and dataset for our EMNLP 2024 Findings paper: Stark: Social Long-Term Multi-Modal Conversation with Persona Commonsense Kn…
  ☆19Updated 5 months ago
• sail-sg / AnytimeReasoner
  Optimizing Anytime Reasoning via Budget Relative Policy Optimization
  ☆38Updated 3 weeks ago
• aszala / VPEval
  VPEval Codebase from Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆45Updated last year
• MJ-Bench / MJ-Bench
  Official implementation for "MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?"
  ☆44Updated 3 weeks ago
• yunfeixie233 / ViGaL
  ☆35Updated 2 weeks ago
• open-compass / GPassK
  [ACL 2025] Are Your LLMs Capable of Stable Reasoning?
  ☆25Updated 3 months ago
• hila-chefer / Conceptor
  Official implementation of the paper The Hidden Language of Diffusion Models
  ☆73Updated last year
• kokolerk / TON
  Think or Not? Selective Reasoning via Reinforcement Learning for Vision-Language Models
  ☆35Updated last week
• test-time-interaction / TTI
  ☆36Updated 2 weeks ago
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆57Updated 8 months ago
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆46Updated 7 months ago
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆13Updated 11 months ago
• psunlpgroup / VisOnlyQA
  This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…
  ☆23Updated 2 months ago
• Infini-AI-Lab / S2FT
  ☆17Updated 5 months ago
• limenlp / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated last year
• Wang-ML-Lab / multimodal-needle-in-a-haystack
  [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models
  ☆45Updated last month
• TIGER-AI-Lab / QuickVideo
  Quick Long Video Understanding
  ☆55Updated last week
• TIGER-AI-Lab / VISTA
  The code for "VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by VIdeo SpatioTemporal Augmentation" [CVPR2025]
  ☆16Updated 3 months ago
• RE-N-Y / sae
  ☆17Updated 7 months ago
• OPPO-PersonalAI / OAgents
  ☆33Updated this week
• tianyi-lab / C3PO
  Code for "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"
  ☆15Updated 2 months ago
• TIGER-AI-Lab / VisualWebInstruct
  The official repo for "VisualWebInstruct: Scaling up Multimodal Instruction Data through Web Search"
  ☆25Updated last month
• dvlab-research / ARPO
  Official Implementation of ARPO: End-to-End Policy Optimization for GUI Agents with Experience Replay
  ☆78Updated 3 weeks ago
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆44Updated 11 months ago
• chenllliang / MMEvalPro
  [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs
  ☆24Updated 8 months ago