RaptorMai / CompBench

CompBench evaluates the comparative reasoning of multimodal large language models (MLLMs) with 40K image pairs and questions across 8 dimensions of relative comparison: visual attribute, existence, state, emotion, temporality, spatiality, quantity, and quality. CompBench covers diverse visual domains, including animals, fashion, sports, and scen…
36Updated 5 months ago

Alternatives and similar repositories for CompBench:

Users that are interested in CompBench are comparing it to the libraries listed below