graphcore-research / random-bases
Improving Neural Network Training in Low Dimensional Random Bases
☆12Updated 4 years ago
Alternatives and similar repositories for random-bases:
Users that are interested in random-bases are comparing it to the libraries listed below
- CIFAR-5m dataset☆38Updated 4 years ago
- ☆45Updated 5 years ago
- Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)☆48Updated 3 years ago
- Code base for SRSGD.☆28Updated 5 years ago
- Limitations of the Empirical Fisher Approximation☆47Updated this week
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆130Updated 5 years ago
- This repository is no longer maintained. Check☆81Updated 4 years ago
- Computing various norms/measures on over-parametrized neural networks☆49Updated 6 years ago
- Contains code for the NeurIPS 2020 paper by Pan et al., "Continual Deep Learning by FunctionalRegularisation of Memorable Past"☆44Updated 4 years ago
- Code accompanying our paper "Finding trainable sparse networks through Neural Tangent Transfer" to be published at ICML-2020.☆13Updated 4 years ago
- ☆82Updated 5 years ago
- Regularization, Neural Network Training Dynamics☆14Updated 5 years ago
- Code for L0-ARM: Network Sparsification via Stochastic Binary Optimization☆15Updated 5 years ago
- Estimating Gradients for Discrete Random Variables by Sampling without Replacement☆40Updated 5 years ago
- PyTorch implementation of HashedNets☆36Updated last year
- Code release to reproduce ASHA experiments from "Random Search and Reproducibility for NAS."☆22Updated 5 years ago
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆38Updated 5 years ago
- ☆74Updated 5 years ago
- Code to accompany the paper Radial Bayesian Neural Networks: Beyond Discrete Support In Large-Scale Bayesian Deep Learning☆33Updated 4 years ago
- Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot☆42Updated 4 years ago
- Implementation of Methods Proposed in Preventing Gradient Attenuation in Lipschitz Constrained Convolutional Networks (NeurIPS 2019)☆34Updated 4 years ago
- A Chainer extension for K-FAC☆20Updated 5 years ago
- Implementation of the paper "Meta-Learning by Adjusting Priors Based on Extended PAC-Bayes Theory", Ron Amit and Ron Meir, ICML 2018☆18Updated 3 years ago
- Local search for NAS☆18Updated 4 years ago
- Feasible target propagation code for the paper "Deep Learning as a Mixed Convex-Combinatorial Optimization Problem" by Friesen & Domingos…☆28Updated 6 years ago
- ☆58Updated last year
- A pytorch compatible data loader to create sequence of tasks for Continual Learning☆33Updated 4 years ago
- The rep for the RotateNetworks in ICPR18, Beijing, China.☆33Updated 6 years ago
- Code for Self-Tuning Networks (ICLR 2019) https://arxiv.org/abs/1903.03088☆53Updated 5 years ago
- Low-variance, efficient and unbiased gradient estimation for optimizing models with binary latent variables. (ICLR 2019)☆28Updated 5 years ago