Benchmark your model on out-of-distribution datasets with carefully collected human comparison data (NeurIPS 2021 Oral)
☆359Apr 17, 2025Updated 10 months ago
Alternatives and similar repositories for model-vs-human
Users that are interested in model-vs-human are comparing it to the libraries listed below
Sorting:
- Pre-trained models, data, code & materials from the paper "ImageNet-trained CNNs are biased towards texture; increasing shape bias improv…☆811May 2, 2023Updated 2 years ago
- Code to create Stylized-ImageNet, a stylized version of standard ImageNet (ICLR 2019 Oral)☆524Feb 16, 2026Updated 2 weeks ago
- ☆143Oct 2, 2020Updated 5 years ago
- ImageNet Testbed, associated with the paper "Measuring Robustness to Natural Distribution Shifts in Image Classification."☆119Aug 5, 2023Updated 2 years ago
- ☆111Sep 20, 2023Updated 2 years ago
- Figures & code from the paper "Shortcut Learning in Deep Neural Networks" (Nature Machine Intelligence 2020)☆101Jun 10, 2022Updated 3 years ago
- Visual Representation Learning Benchmark for Self-Supervised Models☆35Apr 18, 2024Updated last year
- This repository contains the code of the distribution shift framework presented in A Fine-Grained Analysis on Distribution Shift (Wiles e…☆86Feb 20, 2026Updated last week
- [ECCV2022] New benchmark for evaluating pre-trained model; New supervised contrastive learning framework.☆110Dec 8, 2023Updated 2 years ago
- ImageNet-R(endition) and DeepAugment (ICCV 2021)☆280Jul 23, 2021Updated 4 years ago
- MetaShift: A Dataset of Datasets for Evaluating Contextual Distribution Shifts and Training Conflicts (ICLR 2022)☆108Aug 29, 2022Updated 3 years ago
- ImageNet-Sketch data set for evaluating model's ability in learning (out-of-domain) semantics at ImageNet scale☆233May 26, 2022Updated 3 years ago
- ☆34Aug 30, 2021Updated 4 years ago
- Corruption and Perturbation Robustness (ICLR 2019)☆1,138Aug 24, 2022Updated 3 years ago
- ☆18Jul 24, 2023Updated 2 years ago
- CNN Neural System Identification Model☆31Feb 7, 2018Updated 8 years ago
- Run CLIP inference on the ImageNet dataset and use these inferences as labels to train other models and again evaluate the trained model …☆12Jun 21, 2021Updated 4 years ago
- A framework for evaluating models on their alignment to brain and behavioral measurements (100+ benchmarks)☆177Updated this week
- code release of research paper "Exploring Long-Sequence Masked Autoencoders"☆100Oct 14, 2022Updated 3 years ago
- A curated list of papers & resources linked to concept learning☆12Aug 9, 2023Updated 2 years ago
- Official repository for "Stylized Adversarial Training" (TPAMI 2022)☆11Dec 30, 2022Updated 3 years ago
- Learning Features with Parameter-Free Layers, ICLR 2022☆84May 3, 2023Updated 2 years ago
- ☆93Feb 20, 2026Updated last week
- Tensorflow implementation of fisheye transformation, mimicking the spatial sampling properties in the primate retina☆17Oct 7, 2019Updated 6 years ago
- A PyTorch implementation of Mugs proposed by our paper "Mugs: A Multi-Granular Self-Supervised Learning Framework".☆84Feb 13, 2024Updated 2 years ago
- Original dataset release for CIFAR-10H☆83Nov 1, 2020Updated 5 years ago
- Official repository for "Intriguing Properties of Vision Transformers" (NeurIPS 2021--Spotlight)☆183Aug 9, 2022Updated 3 years ago
- Code for the ICCV 2023 paper "Benchmarking Low-Shot Robustness to Natural Distribution Shifts"☆11Jan 21, 2024Updated 2 years ago
- DomainBed is a suite to test domain generalization algorithms☆1,599Dec 16, 2025Updated 2 months ago
- Crowdsourcing metrics and test datasets beyond ImageNet (ICML 2022 workshop)☆38May 16, 2024Updated last year
- A machine learning benchmark of in-the-wild distribution shifts, with data loaders, evaluators, and default models.☆592Jan 26, 2024Updated 2 years ago
- ☆19Jul 24, 2023Updated 2 years ago
- ImageNet-CoG is a benchmark for concept generalization. It provides a full evaluation framework for pre-trained visual representations wh…☆26Oct 13, 2021Updated 4 years ago
- Labels and other data for the paper "Are we done with ImageNet?"☆200Dec 8, 2021Updated 4 years ago
- VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.☆3,295Mar 3, 2024Updated 2 years ago
- Official code for the CVPR 2024 Paper "Can Biases in ImageNet Models Explain Generalization?".☆13Jun 24, 2024Updated last year
- ☆13Aug 20, 2021Updated 4 years ago
- Official Pytorch implementation of ReBias (Learning De-biased Representations with Biased Representations), ICML 2020☆174Jul 25, 2024Updated last year
- Robustness and adaptation of ImageNet scale models. Pre-Release, stay tuned for updates.☆137Jul 5, 2023Updated 2 years ago