goodfeli / forgetting
Repository of code for the experiments for the ICLR submission "An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Networks"
☆67Updated 10 years ago
Alternatives and similar repositories for forgetting:
Users that are interested in forgetting are comparing it to the libraries listed below
- Computing various norms/measures on over-parametrized neural networks☆49Updated 6 years ago
- Recurrent Back Propagation, Back Propagation Through Optimization, ICML 2018☆41Updated 6 years ago
- Unsupervised Learning by Predicting Noise☆90Updated 3 years ago
- TensorFlow implementation of (Momentum) Stochastic Variance-Adapted Gradient.☆44Updated 6 years ago
- Implementation of iterative inference in deep latent variable models☆43Updated 5 years ago
- Understanding Short-Horizon Bias in Stochastic Meta-Optimization☆37Updated 6 years ago
- ☆26Updated 5 years ago
- [NeurIPS'19] [PyTorch] Adaptive Regularization in NN☆67Updated 5 years ago
- ☆63Updated 8 years ago
- ☆34Updated 6 years ago
- Related materials for robust and explainable machine learning☆47Updated 7 years ago
- PyTorch implementation of PathNet: Evolution Channels Gradient Descent in Super Neural Networks☆80Updated 7 years ago
- numpy implementation of net 2 net from the paper Net2Net: Accelerating Learning via Knowledge Transfer http://arxiv.org/abs/1511.05641☆53Updated 8 years ago
- The Variational Homoencoder: Learning to learn high capacity generative models from few examples☆34Updated last year
- Implementation of Methods Proposed in Preventing Gradient Attenuation in Lipschitz Constrained Convolutional Networks (NeurIPS 2019)☆34Updated 4 years ago
- Code for "Systematic Generalization: What Is Required and Can It Be Learned"☆37Updated 5 years ago
- Code for Attentive Recurrent Comparators☆57Updated 7 years ago
- An implementation of shampoo☆74Updated 6 years ago
- Code to reproduce some of the figures in the paper "On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima"☆138Updated 7 years ago
- Code for Stochastic Hyperparameter Optimization through Hypernetworks☆23Updated 6 years ago
- Backpropagation training of neural networks with Hebbian plastic connections☆30Updated 3 years ago
- boundary-seeking generative adversarial networks☆46Updated 7 years ago
- Weight initialization schemes for PyTorch nn.Modules☆70Updated 7 years ago
- Contains code relating to this arxiv paper https://arxiv.org/abs/1802.03761☆37Updated 6 years ago
- Train a simple convnet on the MNIST dataset and evaluate the BALD acquisition function☆16Updated 7 years ago
- Odds and Ends and Things I've implemented.☆78Updated 6 years ago
- TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".☆60Updated 6 years ago
- The Singular Values of Convolutional Layers☆71Updated 6 years ago
- Implementation of Adversarial Variational Optimization in PyTorch☆43Updated 6 years ago
- Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)☆136Updated 5 years ago