zeke-xie / artificial-neural-variability-for-deep-learning
[Neural Computation, MIT Press] The PyTorch Implementation of Variable Optimizers/ Neural Variable Risk Minimization proposed in our Neural Computation paper: Artificial Neural Variability for Deep Learning: On overfitting, Noise Memorization, and Catastrophic Forgetting.
☆33Updated 3 years ago
Alternatives and similar repositories for artificial-neural-variability-for-deep-learning:
Users that are interested in artificial-neural-variability-for-deep-learning are comparing it to the libraries listed below
- [ICML 2021] The official PyTorch Implementations of Positive-Negative Momentum Optimizers.☆28Updated 2 years ago
- [NeurIPS 2023] The PyTorch Implementation of Scheduled (Stable) Weight Decay.☆58Updated 11 months ago
- [ICLR 2021] "Long Live the Lottery: The Existence of Winning Tickets in Lifelong Learning" by Tianlong Chen*, Zhenyu Zhang*, Sijia Liu, S…☆23Updated 3 years ago
- Implementation of Effective Sparsification of Neural Networks with Global Sparsity Constraint☆28Updated 2 years ago
- ☆34Updated 5 months ago
- ☆35Updated 3 years ago
- Weight-Averaged Sharpness-Aware Minimization (NeurIPS 2022)☆28Updated 2 years ago
- Official PyTorch implementation of the Fishr regularization for out-of-distribution generalization☆85Updated 2 years ago
- Code for the ICML 2021 and ICLR 2022 papers: Skew Orthogonal Convolutions, Improved deterministic l2 robustness on CIFAR-10 and CIFAR-100☆18Updated 2 years ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 2 years ago
- Code for "Generalisation Guarantees for Continual Learning with Orthogonal Gradient Descent" (ICML 2020 - Lifelong Learning Workshop)☆42Updated 2 years ago
- Official [ICLR] Code Repository for "Gradient Projection Memory for Continual Learning"☆88Updated 3 years ago
- Coresets via Bilevel Optimization☆65Updated 4 years ago
- Continual Learning in Low-rank Orthogonal Subspaces (NeurIPS'20)☆37Updated 4 years ago
- Code for paper "Orthogonal Convolutional Neural Networks".☆114Updated 3 years ago
- Official implementation of paper Gradient Matching for Domain Generalization☆117Updated 3 years ago
- ☆38Updated 2 months ago
- Towards increasing stability of neural networks for continual learning: https://arxiv.org/abs/2006.06958.pdf (NeurIPS'20)☆75Updated last year
- Code for "Just Train Twice: Improving Group Robustness without Training Group Information"☆69Updated 8 months ago
- Gradients as Features for Deep Representation Learning☆43Updated 4 years ago
- Sinkhorn Label Allocation is a label assignment method for semi-supervised self-training algorithms. The SLA algorithm is described in fu…☆53Updated 3 years ago
- ☆67Updated 5 years ago
- [NeurIPS 2021] A Geometric Analysis of Neural Collapse with Unconstrained Features☆53Updated 2 years ago
- PyTorch implementation for the ICLR 2020 paper "Understanding the Limitations of Variational Mutual Information Estimators"☆74Updated 4 years ago
- ☆57Updated last year
- Project for the Large Scale Optimization course at Skoltech☆22Updated 6 years ago
- ☆23Updated 2 years ago
- This framework implements key experiments on the sparse double descent phenomenon (ICML 2022).☆14Updated 2 years ago
- Rethinking Bias-Variance Trade-off for Generalization of Neural Networks☆49Updated 3 years ago
- [ICLR'22] Self-supervised learning optimally robust representations for domain shift.☆23Updated 2 years ago