HazyResearch / mandoline
(ICML 2021) Mandoline: Model Evaluation under Distribution Shift
☆31Updated 3 years ago
Alternatives and similar repositories for mandoline:
Users that are interested in mandoline are comparing it to the libraries listed below
- Model Patching: Closing the Subgroup Performance Gap with Data Augmentation☆42Updated 4 years ago
- Active and Sample-Efficient Model Evaluation☆24Updated 3 years ago
- Label shift experiments☆15Updated 4 years ago
- Combating hidden stratification with GEORGE☆62Updated 3 years ago
- Code for the CVPR 2021 paper: Understanding Failures of Deep Networks via Robust Feature Extraction☆35Updated 2 years ago
- Interactive Weak Supervision: Learning Useful Heuristics for Data Labeling☆31Updated 3 years ago
- Code for NeurIPS 2019 paper "Hierarchical Optimal Transport for Document Representation"☆54Updated 5 years ago
- Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning (AISTATS 2022 Oral)☆40Updated 2 years ago
- Domain Adaptation☆23Updated 3 years ago
- ☆35Updated last year
- Implementation of the spotlight: a method for discovering systematic errors in deep learning models☆11Updated 3 years ago
- Code for "Interpretable Image Recognition with Hierarchical Prototypes"☆18Updated 5 years ago
- An Empirical Study of Invariant Risk Minimization☆27Updated 4 years ago
- Code for gradient rollback, which explains predictions of neural matrix factorization models, as for example used for knowledge base comp…☆21Updated 3 years ago
- Fine-grained ImageNet annotations☆29Updated 4 years ago
- Advances in Neural Information Processing Systems (NeurIPS 2021)☆22Updated 2 years ago
- Parameter-Space Saliency Maps for Explainability☆23Updated last year
- ☆24Updated 3 years ago
- ☆29Updated 3 years ago
- Simple ranking metrics for PyTorch on CPU or GPU☆14Updated 4 years ago
- Measuring data importance over ML pipelines using the Shapley value.☆37Updated 3 months ago
- Code for Overinterpretation paper☆19Updated last year
- Code repository for the AISTATS 2021 paper "Towards Understanding the Optimal Behaviors of Deep Active Learning Algorithms"☆15Updated 3 years ago
- ModelDiff: A Framework for Comparing Learning Algorithms☆54Updated last year
- Official Implementation of "Transferring Inductive Biases Through Knowledge Distillation"☆14Updated 4 years ago
- Implementation of the paper Identifying Mislabeled Data using the Area Under the Margin Ranking: https://arxiv.org/pdf/2001.10528v2.pdf☆21Updated 4 years ago
- Code for Quantifying Ignorance in Individual-Level Causal-Effect Estimates under Hidden Confounding☆21Updated 2 years ago
- Code for "Rissanen Data Analysis: Examining Dataset Characteristics via Description Length" by Ethan Perez, Douwe Kiela, and Kyungyhun Ch…☆35Updated 3 years ago
- Code to study the generalisability of benchmark models on non-stationary EHRs.☆14Updated 5 years ago
- "Predict, then Interpolate: A Simple Algorithm to Learn Stable Classifiers" ICML 2021☆18Updated 3 years ago