jlko / active-testing
Active and Sample-Efficient Model Evaluation
☆24Updated 4 years ago
Alternatives and similar repositories for active-testing:
Users that are interested in active-testing are comparing it to the libraries listed below
- Model Patching: Closing the Subgroup Performance Gap with Data Augmentation☆42Updated 4 years ago
- Code for the CVPR 2021 paper: Understanding Failures of Deep Networks via Robust Feature Extraction☆35Updated 2 years ago
- Improving Transformation Invariance in Contrastive Representation Learning☆13Updated 4 years ago
- Code for the paper "Getting a CLUE: A Method for Explaining Uncertainty Estimates"☆35Updated 11 months ago
- An Empirical Study of Invariant Risk Minimization☆27Updated 4 years ago
- (ICML 2021) Mandoline: Model Evaluation under Distribution Shift☆31Updated 3 years ago
- Fine-grained ImageNet annotations☆29Updated 4 years ago
- ☆44Updated 2 years ago
- Combating hidden stratification with GEORGE☆63Updated 3 years ago
- Code and results accompanying our paper titled RLSbench: Domain Adaptation under Relaxed Label Shift☆34Updated last year
- Source code of "Hold me tight! Influence of discriminative features on deep network boundaries"☆22Updated 3 years ago
- Last-layer Laplace approximation code examples☆83Updated 3 years ago
- Simple data balancing baselines for worst-group-accuracy benchmarks.☆42Updated last year
- Code for experiments to learn uncertainty☆30Updated 2 years ago
- An official PyTorch implementation of "Regression Prior Networks" for effective runtime uncertainty estimation.☆36Updated 4 years ago
- ☆34Updated 3 years ago
- Model-agnostic posthoc calibration without distributional assumptions☆42Updated last year
- Pytorch code for "Improving Self-Supervised Learning by Characterizing Idealized Representations"☆40Updated 2 years ago
- ☆24Updated 4 years ago
- ☆35Updated last year
- Pytorch implementation for "The Surprising Positive Knowledge Transfer in Continual 3D Object Shape Reconstruction"☆33Updated 2 years ago
- Official PyTorch implementation of "Meta-Calibration: Learning of Model Calibration Using Differentiable Expected Calibration Error"☆34Updated last year
- ☆18Updated 3 years ago
- ☆34Updated 4 years ago
- Implementation of the models and datasets used in "An Information-theoretic Approach to Distribution Shifts"☆25Updated 3 years ago
- [ICLR'22] Self-supervised learning optimally robust representations for domain shift.☆23Updated 3 years ago
- ModelDiff: A Framework for Comparing Learning Algorithms☆56Updated last year
- ☆58Updated 3 years ago
- Python package for evaluating model calibration in classification☆19Updated 5 years ago
- Reusable BatchBALD implementation☆78Updated last year