p-lambda / wilds
A machine learning benchmark of in-the-wild distribution shifts, with data loaders, evaluators, and default models.
☆550Updated 9 months ago
Related projects ⓘ
Alternatives and complementary repositories for wilds
- ☆466Updated 3 months ago
- Project site for "Your Classifier is Secretly an Energy-Based Model and You Should Treat it Like One"☆417Updated 2 years ago
- Distributionally robust neural networks for group shifts☆245Updated last year
- PyTorch code to run synthetic experiments.☆413Updated 3 years ago
- ☆398Updated 3 years ago
- The net:cal calibration framework is a Python 3 library for measuring and mitigating miscalibration of uncertainty estimates, e.g., by a …☆344Updated 3 months ago
- A simple way to calibrate your neural network.☆1,098Updated 3 years ago
- 👽 Out-of-Distribution Detection with PyTorch☆248Updated this week
- Implementation of Estimating Training Data Influence by Tracing Gradient Descent (NeurIPS 2020)☆219Updated 2 years ago
- Code for the paper "Calibrating Deep Neural Networks using Focal Loss"☆153Updated 9 months ago
- Code for Deterministic Neural Networks with Appropriate Inductive Biases Capture Epistemic and Aleatoric Uncertainty☆128Updated last year
- Optimal Transport Dataset Distance☆156Updated 2 years ago
- An implementation of the BADGE batch active learning algorithm.☆197Updated 5 months ago
- Domain adaptation made easy. Fully featured, modular, and customizable.☆359Updated last year
- High-quality implementations of standard and SOTA methods on a variety of tasks.☆1,448Updated 3 weeks ago
- Calibration library and code for the paper: Verified Uncertainty Calibration. Ananya Kumar, Percy Liang, Tengyu Ma. NeurIPS 2019 (Spotlig…☆142Updated last year
- Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learning, ICLR 2020☆235Updated last year
- Official repository for CMU Machine Learning Department's 10732: Robustness and Adaptivity in Shifting Environments☆73Updated last year
- Code for the paper "A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks".☆342Updated 5 years ago
- Code repo for "A Simple Baseline for Bayesian Uncertainty in Deep Learning"☆451Updated last year
- Reliability diagrams visualize whether a classifier model needs calibration☆137Updated 2 years ago
- Self-labelling via simultaneous clustering and representation learning. (ICLR 2020)☆532Updated 3 months ago
- Code for "Uncertainty Estimation Using a Single Deep Deterministic Neural Network"☆268Updated 2 years ago
- A Pytorch-Lightning implementation of self-supervised algorithms☆535Updated 2 years ago
- Literature survey, paper reviews, experimental setups and a collection of implementations for baselines methods for predictive uncertaint…☆609Updated 2 years ago
- DomainBed is a suite to test domain generalization algorithms☆1,404Updated 3 months ago
- Corruption and Perturbation Robustness (ICLR 2019)☆1,019Updated 2 years ago
- Benchmark your model on out-of-distribution datasets with carefully collected human comparison data (NeurIPS 2021 Oral)☆336Updated 2 months ago
- Efficient PyTorch Hessian eigendecomposition tools!☆363Updated 8 months ago
- Wrapper for a PyTorch classifier which allows it to output prediction sets. The sets are theoretically guaranteed to contain the true cla…☆227Updated last year