HazyResearch / mandoline
(ICML 2021) Mandoline: Model Evaluation under Distribution Shift
☆31Updated 3 years ago
Alternatives and similar repositories for mandoline:
Users that are interested in mandoline are comparing it to the libraries listed below
- Model Patching: Closing the Subgroup Performance Gap with Data Augmentation☆42Updated 4 years ago
- Active and Sample-Efficient Model Evaluation☆24Updated 3 years ago
- Domain Adaptation☆23Updated 3 years ago
- Fine-grained ImageNet annotations☆29Updated 4 years ago
- Parameter-Space Saliency Maps for Explainability☆23Updated last year
- Label shift experiments☆16Updated 4 years ago
- ☆25Updated 4 years ago
- ☆24Updated 3 years ago
- Code for paper "When Can Models Learn From Explanations? A Formal Framework for Understanding the Roles of Explanation Data"☆14Updated 4 years ago
- Code for the CVPR 2021 paper: Understanding Failures of Deep Networks via Robust Feature Extraction☆35Updated 2 years ago
- ☆36Updated 3 years ago
- The Shape of Data: Intrinsic Distance for Comparing Data Distributions☆12Updated 5 years ago
- MODALS: Modality-agnostic Automated Data Augmentation in the Latent Space☆40Updated 4 years ago
- Interactive Weak Supervision: Learning Useful Heuristics for Data Labeling☆31Updated 4 years ago
- Measuring if attention is explanation with ROAR☆22Updated 2 years ago
- ☆17Updated 4 years ago
- ModelDiff: A Framework for Comparing Learning Algorithms☆55Updated last year
- Official Implementation of "Transferring Inductive Biases Through Knowledge Distillation"☆14Updated 4 years ago
- Code for NeurIPS 2019 paper "Hierarchical Optimal Transport for Document Representation"☆54Updated 5 years ago
- An Empirical Study of Invariant Risk Minimization☆27Updated 4 years ago
- Minimal, standalone library for solving GLMs in PyTorch☆25Updated 3 years ago
- Advances in Neural Information Processing Systems (NeurIPS 2021)☆22Updated 2 years ago
- Implementation of the paper Identifying Mislabeled Data using the Area Under the Margin Ranking: https://arxiv.org/pdf/2001.10528v2.pdf☆21Updated 5 years ago
- Code for "Rissanen Data Analysis: Examining Dataset Characteristics via Description Length" by Ethan Perez, Douwe Kiela, and Kyungyhun Ch…☆35Updated 3 years ago
- Code repository for the AISTATS 2021 paper "Towards Understanding the Optimal Behaviors of Deep Active Learning Algorithms"☆15Updated 3 years ago
- Code for Quantifying Ignorance in Individual-Level Causal-Effect Estimates under Hidden Confounding☆21Updated 2 years ago
- Implementation of the models and datasets used in "An Information-theoretic Approach to Distribution Shifts"☆25Updated 3 years ago
- A simple algorithm to identify and correct for label shift.☆21Updated 7 years ago
- Code for "Interpretable Image Recognition with Hierarchical Prototypes"☆18Updated 5 years ago
- ☆35Updated last year