hollance / reliability-diagrams
Reliability diagrams visualize whether a classifier model needs calibration
☆145Updated 3 years ago
Alternatives and similar repositories for reliability-diagrams:
Users that are interested in reliability-diagrams are comparing it to the libraries listed below
- Code for the paper "Calibrating Deep Neural Networks using Focal Loss"☆160Updated last year
- Calibration library and code for the paper: Verified Uncertainty Calibration. Ananya Kumar, Percy Liang, Tengyu Ma. NeurIPS 2019 (Spotlig…☆144Updated 2 years ago
- Code for "Uncertainty Estimation Using a Single Deep Deterministic Neural Network"☆271Updated 2 years ago
- Calibration of Convolutional Neural Networks☆160Updated last year
- Pytorch library for model calibration metrics and visualizations as well as recalibration methods. In progress!☆70Updated this week
- Code for Deterministic Neural Networks with Appropriate Inductive Biases Capture Epistemic and Aleatoric Uncertainty☆134Updated last year
- The net:cal calibration framework is a Python 3 library for measuring and mitigating miscalibration of uncertainty estimates, e.g., by a …☆353Updated 6 months ago
- Wrapper for a PyTorch classifier which allows it to output prediction sets. The sets are theoretically guaranteed to contain the true cla…☆235Updated 2 years ago
- Code to accompany the paper 'Improving model calibration with accuracy versus uncertainty optimization'.☆55Updated 2 years ago
- Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learning, ICLR 2020☆235Updated 2 years ago
- Code for "On Feature Collapse and Deep Kernel Learning for Single Forward Pass Uncertainty".☆111Updated 2 years ago
- Model-agnostic posthoc calibration without distributional assumptions☆42Updated last year
- ☆66Updated 5 years ago
- Last-layer Laplace approximation code examples☆83Updated 3 years ago
- ☆230Updated 4 years ago
- Bayesianize: A Bayesian neural network wrapper in pytorch☆88Updated 9 months ago
- Wasserstein Adversarial Active Learning☆29Updated 4 years ago
- TensorFlow 2 implementation of the paper Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution …☆45Updated 3 years ago
- A benchmark for distribution shift in tabular data☆50Updated 8 months ago
- ☆99Updated 3 years ago
- Deep Bayesian Active Learning with Image Data by Gal et al. (ICML 2017)☆43Updated 2 years ago
- This repository is the code for Predictive Uncertainty Estimation using Deep Ensemble☆152Updated 2 years ago
- Code for MC Dropout and Model Ensembling Uncertainty Estimate experiments☆64Updated 5 years ago
- A machine learning benchmark of in-the-wild distribution shifts, with data loaders, evaluators, and default models.☆558Updated last year
- ☆120Updated 2 years ago
- DISTIL: Deep dIverSified inTeractIve Learning. An active/inter-active learning library built on py-torch for reducing labeling costs.☆147Updated 2 years ago
- HCOMP '22 -- Eliciting and Learning with Soft Labels from Every Annotator☆10Updated 2 years ago
- Reusable BatchBALD implementation☆77Updated 11 months ago
- [ICML 2023] Change is Hard: A Closer Look at Subpopulation Shift☆105Updated last year
- Posterior Network: Uncertainty Estimation without OOD Samples via Density-Based Pseudo-Counts (Neurips 2020)☆76Updated 2 years ago