RaptorMai / CompBench
CompBench evaluates the comparative reasoning of multimodal large language models (MLLMs) with 40K image pairs and questions across 8 dimensions of relative comparison: visual attribute, existence, state, emotion, temporality, spatiality, quantity, and quality. CompBench covers diverse visual domains, including animals, fashion, sports, and scen…
☆35Updated 6 months ago
Alternatives and similar repositories for CompBench:
Users that are interested in CompBench are comparing it to the libraries listed below
- PyTorch implementation of POEM (Out-of-distribution detection with posterior sampling), ICML 2022☆28Updated last year
- Code for Continuously Changing Corruptions (CCC) benchmark + evaluation☆33Updated 6 months ago
- Test-Time Adaptation via Conjugate Pseudo-Labels☆39Updated last year
- LANCE: Stress-testing Visual Models by Generating Language-guided Counterfactual Images☆32Updated last year
- [NeurIPS21] TTT++: When Does Self-supervised Test-time Training Fail or Thrive?☆65Updated 3 years ago
- This repo implements the CVPR23 paper Trainable Projected Gradient Method for Robust Fine-tuning☆24Updated last year
- Lessons Learned from a Unifying Empirical Study of Parameter-Efficient Transfer Learning (PETL) in Visual Recognition☆28Updated last month
- ☆37Updated 2 years ago
- RanPAC: Random Projections and Pre-trained Models for Continual Learning - Official code repository for NeurIPS 2023 Published Paper☆43Updated 2 weeks ago
- Official Code for NeurIPS 2022 Paper: How Mask Matters: Towards Theoretical Understandings of Masked Autoencoders☆58Updated last year
- This is the official PyTorch Implementation of "SoTTA: Robust Test-Time Adaptation on Noisy Data Streams (NeurIPS '23)" by Taesik Gong*, …☆20Updated 11 months ago
- Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimality (NeurIPS 2023, Spotlight)☆81Updated 3 months ago
- ☆24Updated 2 years ago
- ☆17Updated last year
- ☆42Updated last year
- ☆63Updated last year
- ☆24Updated 3 years ago
- [NeurIPS '24] Frustratingly easy Test-Time Adaptation of VLMs!!☆39Updated 3 months ago
- Official repository for the ICCV 2023 paper: "Waffling around for Performance: Visual Classification with Random Words and Broad Concepts…☆56Updated last year
- ☆52Updated 2 months ago
- ☆107Updated last year
- source code for NeurIPS'23 paper "Dream the Impossible: Outlier Imagination with Diffusion Models"☆66Updated last month
- Official Implementation of CVPR 2022 paper: "Mimicking the Oracle: An Initial Phase Decorrelation Approach for Class Incremental Learning…☆34Updated 2 years ago
- Code Implementation for CVPR 2023 Paper: Class-Incremental Exemplar Compression for Class-Incremental Learning☆24Updated last year
- Augmenting with Language-guided Image Augmentation (ALIA)☆74Updated last year
- (Pytorch) Training ResNets on ImageNet-100 data☆55Updated 3 years ago
- Code for the paper "Representational Continuity for Unsupervised Continual Learning" (ICLR 22)☆95Updated 2 years ago
- source code for ICLR'23 paper "Non-parametric Outlier Synthesis"☆52Updated last year
- Official Code for Dataset Distillation using Neural Feature Regression (NeurIPS 2022)☆47Updated 2 years ago
- Paper of out of distribution detection and generalization☆56Updated last year