gbaydin / hypergradient-descentLinks
Hypergradient descent
☆147Updated last year
Alternatives and similar repositories for hypergradient-descent
Users that are interested in hypergradient-descent are comparing it to the libraries listed below
Sorting:
- Code for ICML 2018 paper on "Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in Adam" by Khan, Nielsen, Tangkaratt, Lin, …☆112Updated 7 years ago
- hessian in pytorch☆187Updated 5 years ago
- Code for Self-Tuning Networks (ICLR 2019) https://arxiv.org/abs/1903.03088☆61Updated 6 years ago
- paper lists and information on mean-field theory of deep learning☆79Updated 6 years ago
- Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)☆142Updated 6 years ago
- This repository is no longer maintained. Check☆81Updated 5 years ago
- TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".☆60Updated 7 years ago
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆148Updated 2 years ago
- Implementation of the Functional Neural Process models☆42Updated 5 years ago
- Optimization with orthogonal constraints and on general manifolds☆130Updated 5 years ago
- ☆126Updated last year
- Implements stochastic line search☆118Updated 2 years ago
- ☆35Updated 4 years ago
- Implementation of "Variational Dropout and the Local Reparameterization Trick" paper with Pytorch☆49Updated 8 years ago
- Convolutional Neural Tangent Kernel☆112Updated 6 years ago
- Code for the paper Gaussian process behaviour in wide deep networks☆46Updated 7 years ago
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆152Updated 2 years ago
- Computing various norms/measures on over-parametrized neural networks☆50Updated 7 years ago
- Reliable Uncertainty Estimates in Deep Neural Networks using Noise Contrastive Priors☆62Updated 5 years ago
- Memory efficient MAML using gradient checkpointing☆86Updated 6 years ago
- Sample code for running deterministic variational inference to train Bayesian neural networks☆102Updated 7 years ago
- ☆135Updated 8 years ago
- ☆181Updated 6 years ago
- Implementation of iterative inference in deep latent variable models☆43Updated 6 years ago
- Limitations of the Empirical Fisher Approximation☆49Updated 11 months ago
- Autoregressive Energy Machines☆78Updated 3 years ago
- Optimizing control variates for black-box gradient estimation☆163Updated 6 years ago
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆133Updated 6 years ago
- The original code for the paper "How to train your MAML" along with a replication of the original "Model Agnostic Meta Learning" (MAML) p…☆41Updated 5 years ago
- Understanding normalizing flows☆132Updated 6 years ago