[ICML 2024 Oral] Official code repository for MLLM-as-a-Judge.
☆92Feb 17, 2025Updated last year
Alternatives and similar repositories for MLLM-Judge
Users that are interested in MLLM-Judge are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆28Jul 23, 2025Updated 8 months ago
- (NAACL 2024) Official code repository for Mixset.☆26Dec 4, 2024Updated last year
- ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback☆77Sep 12, 2024Updated last year
- An LLM leaderboard for stateful agents☆21Oct 16, 2025Updated 6 months ago
- [CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(…☆336Oct 14, 2025Updated 6 months ago
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆16May 27, 2024Updated last year
- (ICLR 2025) The Official Code Repository for GUI-World.☆69Dec 18, 2024Updated last year
- NeurIPS 2025 Poster☆26Feb 4, 2025Updated last year
- Accelerating the development of large multimodal models (LMMs) with lmms-eval☆14Oct 14, 2024Updated last year
- Extending context length of visual language models☆12Dec 18, 2024Updated last year
- Computer-Use Agents as Judges for Generative UI☆45Nov 27, 2025Updated 4 months ago
- HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)☆52Jul 16, 2024Updated last year
- [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…☆83Sep 13, 2024Updated last year
- [AAAI-26] Are We on the Right Way for Assessing Document Retrieval-Augmented Generation?☆29Dec 14, 2025Updated 4 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆18Aug 1, 2024Updated last year
- Official InfiniBench: A Benchmark for Large Multi-Modal Models in Long-Form Movies and TV Shows☆19Nov 4, 2025Updated 5 months ago
- An LLM-free Multi-dimensional Benchmark for Multi-modal Hallucination Evaluation☆163Jan 15, 2024Updated 2 years ago
- Official repository for Decentralized Arena via Collective LLM Intelligence☆17May 19, 2025Updated 10 months ago
- ☆19Oct 28, 2025Updated 5 months ago
- [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models☆87Oct 26, 2025Updated 5 months ago
- [NeurIPS 2024] MATH-Vision dataset and code to measure multimodal mathematical reasoning capabilities.☆133May 16, 2025Updated 11 months ago
- [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.☆72Nov 27, 2024Updated last year
- VHTest☆16Oct 31, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code for paper: "Executing Arithmetic: Fine-Tuning Large Language Models as Turing Machines"☆11Oct 11, 2024Updated last year
- (ICLR 2025 Spotlight) Official code repository for Interleaved Scene Graph.☆31Aug 7, 2025Updated 8 months ago
- This repo contains code and data for ICLR 2025 paper MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMs☆38Mar 9, 2025Updated last year
- Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)☆99Oct 19, 2024Updated last year
- VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs☆55Mar 9, 2025Updated last year
- ☆55Mar 19, 2025Updated last year
- MathVista: data, code, and evaluation for Mathematical Reasoning in Visual Contexts☆359Sep 29, 2025Updated 6 months ago
- ☆18Jul 10, 2024Updated last year
- Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."☆53Oct 19, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- An implementation of (Chambers and Jurafsky, 2008), using updated machine learning models, and different training data domains for an ind…☆14Dec 8, 2022Updated 3 years ago
- ☆18Jun 10, 2023Updated 2 years ago
- ☆32Feb 8, 2024Updated 2 years ago
- New Modeling The Background CodeBase☆15Jan 7, 2022Updated 4 years ago
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆131Apr 4, 2025Updated last year
- ☆11Mar 31, 2022Updated 4 years ago
- Python Implementation of Weighted Generalized Canonical Correlation Analysis☆33Apr 30, 2018Updated 7 years ago