jlko / active-testing
Active and Sample-Efficient Model Evaluation
☆24Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for active-testing
- ModelDiff: A Framework for Comparing Learning Algorithms☆53Updated last year
- ☆41Updated last year
- Model Patching: Closing the Subgroup Performance Gap with Data Augmentation☆42Updated 4 years ago
- Simple data balancing baselines for worst-group-accuracy benchmarks.☆40Updated last year
- Code for the CVPR 2021 paper: Understanding Failures of Deep Networks via Robust Feature Extraction☆35Updated 2 years ago
- Pytorch code for "Improving Self-Supervised Learning by Characterizing Idealized Representations"☆40Updated last year
- ☆18Updated 3 years ago
- Gradient Starvation: A Learning Proclivity in Neural Networks☆60Updated 3 years ago
- Code to implement the AND-mask and geometric mean to do gradient based optimization, from the paper "Learning explanations that are hard …☆39Updated 4 years ago
- ☆35Updated last year
- Improving Transformation Invariance in Contrastive Representation Learning☆13Updated 3 years ago
- Combating hidden stratification with GEORGE☆62Updated 3 years ago
- LISA for ICML 2022☆47Updated last year
- The official repository for "Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning" paper.☆40Updated 2 years ago
- Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning (AISTATS 2022 Oral)☆40Updated 2 years ago
- Reusable BatchBALD implementation☆74Updated 8 months ago
- Code and results accompanying our paper titled RLSbench: Domain Adaptation under Relaxed Label Shift☆35Updated last year
- Fine-grained ImageNet annotations☆29Updated 4 years ago
- Implementation of the models and datasets used in "An Information-theoretic Approach to Distribution Shifts"☆25Updated 3 years ago
- This is reimplementation of "Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awareness" in Pyt…☆47Updated 3 years ago
- A way to achieve uniform confidence far away from the training data.☆36Updated 3 years ago
- Official PyTorch implementation of the Fishr regularization for out-of-distribution generalization☆83Updated 2 years ago
- Code for experiments to learn uncertainty☆30Updated last year
- Label shift experiments☆15Updated 3 years ago
- (ICML 2021) Mandoline: Model Evaluation under Distribution Shift☆31Updated 3 years ago
- A regularized self-labeling approach to improve the generalization and robustness of fine-tuned models☆27Updated 2 years ago
- Pytorch implementation for "The Surprising Positive Knowledge Transfer in Continual 3D Object Shape Reconstruction"☆33Updated 2 years ago
- ☆58Updated 2 years ago
- An uncertainty-based random sampling algorithm for data augmentation☆30Updated 4 years ago
- Official PyTorch implementation of "Meta-Calibration: Learning of Model Calibration Using Differentiable Expected Calibration Error"☆32Updated last year