modestyachts / imagenet-testbedView external linksLinks
ImageNet Testbed, associated with the paper "Measuring Robustness to Natural Distribution Shifts in Image Classification."
☆119Aug 5, 2023Updated 2 years ago
Alternatives and similar repositories for imagenet-testbed
Users that are interested in imagenet-testbed are comparing it to the libraries listed below
Sorting:
- This repository provides code for "On Interaction Between Augmentations and Corruptions in Natural Corruption Robustness".☆46Nov 6, 2022Updated 3 years ago
- Host CIFAR-10.2 Data Set☆13Sep 22, 2021Updated 4 years ago
- ImageNet-R(endition) and DeepAugment (ICCV 2021)☆281Jul 23, 2021Updated 4 years ago
- A machine learning benchmark of in-the-wild distribution shifts, with data loaders, evaluators, and default models.☆592Jan 26, 2024Updated 2 years ago
- Release of CIFAR-10.1, a new test set for CIFAR-10.☆225Apr 16, 2020Updated 5 years ago
- ModelDiff: A Framework for Comparing Learning Algorithms☆58Aug 15, 2023Updated 2 years ago
- Dataset Interfaces: Diagnosing Model Failures Using Controllable Counterfactual Generation☆45Feb 27, 2023Updated 2 years ago
- ☆56Aug 14, 2020Updated 5 years ago
- ☆25May 20, 2020Updated 5 years ago
- Distilling Model Failures as Directions in Latent Space☆47Feb 8, 2023Updated 3 years ago
- Visual Representation Learning Benchmark for Self-Supervised Models☆35Apr 18, 2024Updated last year
- Benchmark your model on out-of-distribution datasets with carefully collected human comparison data (NeurIPS 2021 Oral)☆358Apr 17, 2025Updated 9 months ago
- Crowdsourcing metrics and test datasets beyond ImageNet (ICML 2022 workshop)☆38May 16, 2024Updated last year
- ☆143Oct 2, 2020Updated 5 years ago
- An adaptive training algorithm for residual network☆17Aug 22, 2020Updated 5 years ago
- Code for the paper "Evading Black-box Classifiers Without Breaking Eggs" [SaTML 2024]☆21Apr 15, 2024Updated last year
- Predicting Out-of-Distribution Error with the Projection Norm☆19Jul 27, 2022Updated 3 years ago
- Fine-grained ImageNet annotations☆30May 25, 2020Updated 5 years ago
- CIFAR-10-Warehouse: Towards Broad and More Realistic Testbeds in Model Generalization Analysis☆18Jul 15, 2024Updated last year
- On the effectiveness of adversarial training against common corruptions [UAI 2022]☆30May 16, 2022Updated 3 years ago
- ImageNet-CoG is a benchmark for concept generalization. It provides a full evaluation framework for pre-trained visual representations wh…☆26Oct 13, 2021Updated 4 years ago
- Code for the ICCV 2023 paper "Benchmarking Low-Shot Robustness to Natural Distribution Shifts"☆11Jan 21, 2024Updated 2 years ago
- Provable Worst Case Guarantees for the Detection of Out-of-Distribution Data☆13Sep 20, 2022Updated 3 years ago
- [ECCV2022] New benchmark for evaluating pre-trained model; New supervised contrastive learning framework.☆110Dec 8, 2023Updated 2 years ago
- Learning perturbation sets for robust machine learning☆65Aug 23, 2021Updated 4 years ago
- ☆19Jul 18, 2022Updated 3 years ago
- ☆111Sep 20, 2023Updated 2 years ago
- Code and results accompanying our paper titled RLSbench: Domain Adaptation under Relaxed Label Shift☆35Jul 19, 2023Updated 2 years ago
- Data for "Datamodels: Predicting Predictions with Training Data"☆97May 25, 2023Updated 2 years ago
- Experiments for the NeurIPS 2021 paper "Cockpit: A Practical Debugging Tool for the Training of Deep Neural Networks"☆13Oct 25, 2021Updated 4 years ago
- Code for the paper "Adversarial Training and Robustness for Multiple Perturbations", NeurIPS 2019☆47Dec 8, 2022Updated 3 years ago
- RobustBench: a standardized adversarial robustness benchmark [NeurIPS 2021 Benchmarks and Datasets Track]☆768Mar 31, 2025Updated 10 months ago
- [ICML'21] Estimate the accuracy of the classifier in various environments through self-supervision☆27Sep 2, 2021Updated 4 years ago
- ☆16Dec 7, 2021Updated 4 years ago
- ☆12Jul 17, 2023Updated 2 years ago
- DiWA: Diverse Weight Averaging for Out-of-Distribution Generalization☆31Jan 31, 2023Updated 3 years ago
- Code for T-MARS data filtering☆35Aug 23, 2023Updated 2 years ago
- PRIME: A Few Primitives Can Boost Robustness to Common Corruptions☆41Dec 22, 2022Updated 3 years ago
- DomainBed is a suite to test domain generalization algorithms☆1,597Dec 16, 2025Updated last month