[ACL 2025] Redundancy Principles for MLLMs Benchmarks
☆10Aug 20, 2025Updated last year
Alternatives and similar repositories for Benchmark-Redundancy
Users that are interested in Benchmark-Redundancy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Perceptual Quality Assessment for Embodied AI☆12Feb 10, 2026Updated 8 months ago
- [arxiv‘25] LMM-JND: Just Noticeable Differences for Large Multimodal Models☆12Jul 4, 2025Updated last year
- LMM for VQA, tcsvt version☆10Jul 19, 2024Updated 2 years ago
- Assessing Context-Aware Creative Intelligence in MLLMs☆23Jul 22, 2025Updated last year
- ☆23Apr 11, 2026Updated 6 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Collections of papers and code for employing MLLM for quality assessment tasks.☆12Apr 18, 2024Updated 2 years ago
- Official repo for "GMS-3DQA: Projection-based Grid Mini-patch Sampling for 3D Model Quality Assessment"☆15Mar 10, 2024Updated 2 years ago
- [ACMMM2025] Official released code for VQA² series models☆71Apr 21, 2026Updated 6 months ago
- [WIP@Oct 13] 质衡-基准测试 (Q-Bench in Chinese)，包含中文版【底层视觉问答】和【底层视觉描述】数据集，以及中文提示下的图片质量评价。 We will release Q-Bench in more languages in the futu…☆24Jan 7, 2024Updated 2 years ago
- Official Repository of ACL 2025 paper OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference☆144Apr 2, 2026Updated 6 months ago
- [TMM] MINT-IQA: Quality Assessment for AI Generated Images with Instruction Tuning☆21Nov 21, 2025Updated 11 months ago
- SQAD: Automatic Smartphone Camera Quality Assessment and Benchmarking☆28Aug 23, 2025Updated last year
- Analysis of video quality datasets via design of minimalistic video quality models☆24Jul 15, 2024Updated 2 years ago
- [NeurIPS'24 Spotlight] GAIA: Rethinking Action Quality Assessment for AI-Generated Videos☆42Apr 1, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [ICCV 2025] MM-IFEngine: Towards Multimodal Instruction Following☆126Oct 5, 2026Updated 3 weeks ago
- [MM 2024 Oral] Refiner for AIGC☆28Jul 29, 2024Updated 2 years ago
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆44Jun 28, 2024Updated 2 years ago
- This repository is the official PyTorch implementation of MA-AGIQA:Large Multi-modality Model Assisted AI-Generated Image Quality Assessm…☆27Sep 28, 2024Updated 2 years ago
- [CVPR 2025] A benchmark for video quality understanding of LMMs☆113Mar 14, 2025Updated last year
- [Neurips 24 Spotlight] Training in Pairs + Inference on Single Image with Anchors☆53Feb 20, 2025Updated last year
- [AAAI 2026] Official released code for Refine-IQA (support vllm training-about ×3 faster)☆15Nov 15, 2025Updated 11 months ago
- ☆17Oct 21, 2024Updated 2 years ago
- [ICLR'26] "Grounding-IQA: Grounding Multimodal Language Model for Image Quality Assessment"☆68May 20, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [IEEE JSTSP 2025] Using LMM in Real-world Distortion☆15Oct 13, 2024Updated 2 years ago
- [ACMMM 2025] Benchmarking MLLM Codec Ability☆33Jun 14, 2024Updated 2 years ago
- [IEEE TCSVT2023] A Fine-grained Subjective Perception & Alignment Database for AI Generated Image Quality Assessment☆70Oct 24, 2023Updated 3 years ago
- Official implementation of "MoDoMoDo: Multi-Domain Data Mixtures for Multimodal LLM Reinforcement Learning"☆11Aug 23, 2025Updated last year
- Official repo for `LMM-PCQA: Assisting Point Cloud Quality Assessment with LMM', ACM MM2024 Oral☆17Nov 21, 2024Updated last year
- ☆20Jan 13, 2024Updated 2 years ago
- Implementation of QoMEX 2021 "Image Super-Resolution Quality Assessment: Structural Fidelity Versus Statistical Naturalness"☆16Sep 28, 2022Updated 4 years ago
- [IEEE TCSVT'24] Study of Subjective and Objective Naturalness Assessment of AI-Generated Images☆38Aug 14, 2026Updated 2 months ago
- [ICME 2023 Oral, Extended to TIP (UR)] The best zero-shot VQA approach that even outperforms several fully-supervised methods.☆41Jul 11, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [IEEE TIP 2024] Ultra-low Bitrate Image Semantic Compression Driven by Large Multimodal Model☆36Apr 24, 2024Updated 2 years ago
- ④[ECCV 2024 Oral, Comparison among Multiple Images!] A study on open-ended multi-image quality comparison: a dataset, a model and a bench…☆87Sep 29, 2024Updated 2 years ago
- [TPAMI] Multi-modality Multi-attribute Contrastive Pre-training for Image Aesthetics Computing☆25Jul 3, 2025Updated last year
- [NeurIPS 2025 DB Oral] Reasoning-Informed Visual Editing☆165Updated this week
- 🏆 🥇 Winner Solution for ICCV VQualA 2025 EVQA-SnapUGC Challenge at VQualA 2025 Workshop @ ICCV 2025☆20Aug 8, 2025Updated last year
- Teaching LMMs for Image Quality Scoring and Interpreting☆100Mar 25, 2025Updated last year
- [ACMMM 2024] AesExpert: Towards Multi-modality Foundation Model for Image Aesthetics Perception☆106Jan 19, 2025Updated last year