RaptorMai / MLLM-CompBenchLinks
[NeurIPS'25] MLLM-CompBench evaluates the comparative reasoning of MLLMs with 40K image pairs and questions across 8 dimensions of relative comparison: visual attribute, existence, state, emotion, temporality, spatiality, quantity, and quality. CompBench covers diverse visual domains, including animals, fashion, sports, and scenes
☆41Updated 7 months ago
Alternatives and similar repositories for MLLM-CompBench
Users that are interested in MLLM-CompBench are comparing it to the libraries listed below
Sorting:
- ☆23Updated last year
- LANCE: Stress-testing Visual Models by Generating Language-guided Counterfactual Images☆32Updated 2 years ago
- ☆27Updated 2 years ago
- This repo implements the CVPR23 paper Trainable Projected Gradient Method for Robust Fine-tuning☆24Updated 2 years ago
- ☆69Updated 2 years ago
- ☆27Updated last year
- [DMLR 2024] Benchmarking Robustness of Multimodal Image-Text Models under Distribution Shift☆38Updated last year
- PyTorch implementation of POEM (Out-of-distribution detection with posterior sampling), ICML 2022☆28Updated 2 years ago
- ☆39Updated 3 years ago
- [CVPR23] "Understanding and Improving Visual Prompting: A Label-Mapping Perspective" by Aochuan Chen, Yuguang Yao, Pin-Yu Chen, Yihua Zha…☆53Updated 2 years ago
- Implementation for ECCV 2022 Paper "Class Is Invariant to Context and Vice Versa: On Learning Invariance for Out-Of-Distribution Generali…☆20Updated 3 years ago
- [NeurIPS 2023] Generalized Logit Adjustment☆39Updated last year
- Code for Debiasing Vision-Language Models via Biased Prompts☆57Updated 2 years ago
- Official repository for the ICCV 2023 paper: "Waffling around for Performance: Visual Classification with Random Words and Broad Concepts…☆61Updated 2 years ago
- source code for NeurIPS'23 paper "Dream the Impossible: Outlier Imagination with Diffusion Models"☆72Updated 7 months ago
- Official pytorch implementation of "Interpreting the Second-Order Effects of Neurons in CLIP"☆40Updated last year
- Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimality (NeurIPS 2023, Spotlight)☆88Updated last year
- [NeurIPS] TTT++: When Does Self-supervised Test-time Training Fail or Thrive?☆72Updated 3 years ago
- Official implementation for CVPR'23 paper "BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning"☆110Updated 2 years ago
- ☆60Updated 11 months ago
- The Continual Learning in Multimodality Benchmark☆68Updated 2 years ago
- Test-Time Adaptation via Conjugate Pseudo-Labels☆43Updated 2 years ago
- Create generated datasets and train robust classifiers☆36Updated 2 years ago
- ☆18Updated 2 years ago
- Augmenting with Language-guided Image Augmentation (ALIA)☆80Updated 2 years ago
- Metrics for "Beyond neural scaling laws: beating power law scaling via data pruning " (NeurIPS 2022 Outstanding Paper Award)☆57Updated 2 years ago
- ☆25Updated 4 months ago
- Official Code for Dataset Distillation using Neural Feature Regression (NeurIPS 2022)☆48Updated 3 years ago
- Test-time Prompt Tuning (TPT) for zero-shot generalization in vision-language models (NeurIPS 2022))☆199Updated 3 years ago
- IDEAL: Influence-Driven Selective Annotations Empower In-Context Learners in Large Language Models☆59Updated last year