[ICML 2024 Oral] Official code repository for MLLM-as-a-Judge.
☆90Feb 17, 2025Updated last year
Alternatives and similar repositories for MLLM-Judge
Users that are interested in MLLM-Judge are comparing it to the libraries listed below
Sorting:
- [NeurIPS 2024] HonestLLM: Toward an Honest and Helpful Large Language Model☆29Jun 10, 2025Updated 8 months ago
- Official repository for Decentralized Arena via Collective LLM Intelligence☆17May 19, 2025Updated 9 months ago
- ☆27Jul 23, 2025Updated 7 months ago
- [CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(…☆329Oct 14, 2025Updated 4 months ago
- Official InfiniBench: A Benchmark for Large Multi-Modal Models in Long-Form Movies and TV Shows☆19Nov 4, 2025Updated 4 months ago
- Code for paper: "Executing Arithmetic: Fine-Tuning Large Language Models as Turing Machines"☆11Oct 11, 2024Updated last year
- (NAACL 2024) Official code repository for Mixset.☆27Dec 4, 2024Updated last year
- ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback☆77Sep 12, 2024Updated last year
- An LLM leaderboard for stateful agents☆20Oct 16, 2025Updated 4 months ago
- The source codes for Region Comparison Network for Interpretable Few-shot Image Classification☆10Sep 17, 2020Updated 5 years ago
- HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)☆52Jul 16, 2024Updated last year
- This Russia Doesn't Exist☆14Feb 21, 2024Updated 2 years ago
- Code and data for Distributional Correlation–Aware Knowledge Distillation for Stock Trading Volume Prediction (ECML-PKDD 22)☆15Sep 6, 2022Updated 3 years ago
- The source codes for paper "Relative Position and Map Networks in Few-shot Learning for Image Classification"☆14Jul 12, 2020Updated 5 years ago
- [NeurIPS 2024] MATH-Vision dataset and code to measure multimodal mathematical reasoning capabilities.☆130May 16, 2025Updated 9 months ago
- [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models☆86Oct 26, 2025Updated 4 months ago
- Extending context length of visual language models☆12Dec 18, 2024Updated last year
- Open-source code for ''Individual Fairness for Graph Neural Networks: A Ranking based Approach''.☆12Jul 8, 2022Updated 3 years ago
- ☆18Jul 10, 2024Updated last year
- An implementation of (Chambers and Jurafsky, 2008), using updated machine learning models, and different training data domains for an ind…☆14Dec 8, 2022Updated 3 years ago
- VHTest☆15Oct 31, 2024Updated last year
- Computer-Use Agents as Judges for Generative UI☆43Nov 27, 2025Updated 3 months ago
- ☆17Aug 1, 2024Updated last year
- An LLM-free Multi-dimensional Benchmark for Multi-modal Hallucination Evaluation☆157Jan 15, 2024Updated 2 years ago
- (ICLR 2025) The Official Code Repository for GUI-World.☆68Dec 18, 2024Updated last year
- ☆16Oct 21, 2024Updated last year
- ☆18Oct 28, 2025Updated 4 months ago
- Accelerating the development of large multimodal models (LMMs) with lmms-eval☆14Oct 14, 2024Updated last year
- [ICCV 2025] LVBench: An Extreme Long Video Understanding Benchmark☆137Jul 9, 2025Updated 7 months ago
- Group-conditional DRO to alleviate spurious correlations☆15Jul 15, 2021Updated 4 years ago
- [AAAI-26] Are We on the Right Way for Assessing Document Retrieval-Augmented Generation?☆26Dec 14, 2025Updated 2 months ago
- Official Implementation for "Editing Massive Concepts in Text-to-Image Diffusion Models"☆19Mar 21, 2024Updated last year
- [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…☆80Sep 13, 2024Updated last year
- ☆82Jul 27, 2024Updated last year
- MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria☆72Oct 16, 2024Updated last year
- The official repository of "Video assistant towards large language model makes everything easy"☆232Dec 24, 2024Updated last year
- ☆43Oct 7, 2024Updated last year
- VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)☆42Dec 16, 2025Updated 2 months ago
- ☆18Jun 10, 2023Updated 2 years ago