zeke-xie / artificial-neural-variability-for-deep-learning
[Neural Computation, MIT Press] The PyTorch Implementation of Variable Optimizers/ Neural Variable Risk Minimization proposed in our Neural Computation paper: Artificial Neural Variability for Deep Learning: On overfitting, Noise Memorization, and Catastrophic Forgetting.
☆33Updated 3 years ago
Alternatives and similar repositories for artificial-neural-variability-for-deep-learning:
Users that are interested in artificial-neural-variability-for-deep-learning are comparing it to the libraries listed below
- [ICML 2021] The official PyTorch Implementations of Positive-Negative Momentum Optimizers.☆28Updated 2 years ago
- [NeurIPS 2023] The PyTorch Implementation of Scheduled (Stable) Weight Decay.☆59Updated last year
- ☆57Updated 2 years ago
- Towards increasing stability of neural networks for continual learning: https://arxiv.org/abs/2006.06958.pdf (NeurIPS'20)☆75Updated 2 years ago
- Official implementation of paper Gradient Matching for Domain Generalization☆119Updated 3 years ago
- ☆34Updated this week
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 2 years ago
- Official code for "In Search of Robust Measures of Generalization" (NeurIPS 2020)☆28Updated 4 years ago
- [ICLR'22] Self-supervised learning optimally robust representations for domain shift.☆23Updated 3 years ago
- Visualization of mean field and neural tangent kernel regime☆20Updated 8 months ago
- Code for "Just Train Twice: Improving Group Robustness without Training Group Information"☆71Updated 10 months ago
- The Pitfalls of Simplicity Bias in Neural Networks [NeurIPS 2020] (http://arxiv.org/abs/2006.07710v2)☆39Updated last year
- ☆39Updated 5 years ago
- [ICLR 2021] "Long Live the Lottery: The Existence of Winning Tickets in Lifelong Learning" by Tianlong Chen*, Zhenyu Zhang*, Sijia Liu, S…☆25Updated 3 years ago
- Weight-Averaged Sharpness-Aware Minimization (NeurIPS 2022)☆28Updated 2 years ago
- Project for the Large Scale Optimization course at Skoltech☆22Updated 6 years ago
- A way to achieve uniform confidence far away from the training data.☆37Updated 3 years ago
- Gradients as Features for Deep Representation Learning☆43Updated 5 years ago
- ICLR 2021, Fair Mixup: Fairness via Interpolation☆55Updated 3 years ago
- Implementation of Effective Sparsification of Neural Networks with Global Sparsity Constraint☆31Updated 3 years ago
- Continual Learning in Low-rank Orthogonal Subspaces (NeurIPS'20)☆36Updated 4 years ago
- Source code of "What can linearized neural networks actually say about generalization?☆20Updated 3 years ago
- Gradient Starvation: A Learning Proclivity in Neural Networks☆61Updated 4 years ago
- Code for Model Agnostic Sample Reweighting for Out-of-Distribution Learning☆43Updated last year
- ☆58Updated last year
- Code for "Generalisation Guarantees for Continual Learning with Orthogonal Gradient Descent" (ICML 2020 - Lifelong Learning Workshop)☆42Updated 2 years ago
- This framework implements key experiments on the sparse double descent phenomenon (ICML 2022).☆14Updated 2 years ago
- ☆36Updated 3 years ago
- Repo for the paper: "Agree to Disagree: Diversity through Disagreement for Better Transferability"☆35Updated 2 years ago
- ☆66Updated 6 years ago