mpezeshki / Gradient_Starvation
Gradient Starvation: A Learning Proclivity in Neural Networks
☆61Updated 4 years ago
Alternatives and similar repositories for Gradient_Starvation:
Users that are interested in Gradient_Starvation are comparing it to the libraries listed below
- ☆54Updated 4 years ago
- ☆34Updated 3 years ago
- ☆34Updated 4 years ago
- Official PyTorch implementation of the Fishr regularization for out-of-distribution generalization☆85Updated 2 years ago
- Simple data balancing baselines for worst-group-accuracy benchmarks.☆42Updated last year
- Official implementation of paper Gradient Matching for Domain Generalization☆120Updated 3 years ago
- Code to implement the AND-mask and geometric mean to do gradient based optimization, from the paper "Learning explanations that are hard …☆39Updated 4 years ago
- Computing various measures and generalization bounds on convolutional and fully connected networks☆35Updated 6 years ago
- Code for "Supermasks in Superposition"☆121Updated last year
- Code for the paper "Understanding Generalization through Visualizations"☆60Updated 4 years ago
- ☆45Updated 2 years ago
- Code for "Just Train Twice: Improving Group Robustness without Training Group Information"☆71Updated 10 months ago
- A way to achieve uniform confidence far away from the training data.☆37Updated 3 years ago
- Improving Transformation Invariance in Contrastive Representation Learning☆13Updated 4 years ago
- Rethinking Bias-Variance Trade-off for Generalization of Neural Networks☆49Updated 4 years ago
- Code for the CVPR 2021 paper: Understanding Failures of Deep Networks via Robust Feature Extraction☆35Updated 2 years ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 2 years ago
- [ICLR'22] Self-supervised learning optimally robust representations for domain shift.☆23Updated 3 years ago
- ☆64Updated 4 years ago
- ☆46Updated 4 years ago
- Official code for "In Search of Robust Measures of Generalization" (NeurIPS 2020)☆28Updated 4 years ago
- ☆38Updated 3 years ago
- The Pitfalls of Simplicity Bias in Neural Networks [NeurIPS 2020] (http://arxiv.org/abs/2006.07710v2)☆39Updated last year
- ICML 2020, Estimating Generalization under Distribution Shifts via Domain-Invariant Representations☆22Updated 4 years ago
- ☆35Updated last year
- Hybrid Discriminative-Generative Training via Contrastive Learning☆75Updated last year
- ☆57Updated 2 years ago
- Code to reproduce experiments from 'Does Knowledge Distillation Really Work' a paper which appeared in the 2021 NeurIPS proceedings.☆33Updated last year
- ☆58Updated 3 years ago
- ☆19Updated 2 years ago