yaroslavvb / kfac_pytorch
☆132Updated 7 years ago
Alternatives and similar repositories for kfac_pytorch:
Users that are interested in kfac_pytorch are comparing it to the libraries listed below
- Forward-mode Automatic Differentiation for TensorFlow☆140Updated 6 years ago
- Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)☆136Updated 5 years ago
- Code used to generate the results appearing in "Train longer, generalize better: closing the generalization gap in large batch training o…☆148Updated 7 years ago
- TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".☆60Updated 6 years ago
- A Python implementation of the gradient REBAR estimator.☆46Updated 6 years ago
- Code for paper "L4: Practical loss-based stepsize adaptation for deep learning"☆124Updated 5 years ago
- Multiplicative Normalizing Flow (MNF) posteriors for variational Bayesian neural networks☆65Updated 4 years ago
- Code for "A Spectral Approach to Gradient Estimation for Implicit Distributions" (ICML'18)☆32Updated last year
- Code for the paper Implicit Weight Uncertainty in Neural Networks☆65Updated 5 years ago
- Example implementation of the Bayesian neural network in "Structured and Efficient Variational Deep Learning with Matrix Gaussian Posteri…☆30Updated 4 years ago
- Lua implementation of Entropy-SGD☆81Updated 6 years ago
- This repository is no longer maintained. Check☆81Updated 4 years ago
- Optimizing control variates for black-box gradient estimation☆162Updated 5 years ago
- Reliable Uncertainty Estimates in Deep Neural Networks using Noise Contrastive Priors☆63Updated 4 years ago
- Limitations of the Empirical Fisher Approximation☆47Updated 4 years ago
- hessian in pytorch☆186Updated 4 years ago
- simple implementation of "Improved Variational Inference with Inverse Autoregressive Flow" paper with pytorch☆52Updated 7 years ago
- Pytorch Implementation of paper "Noisy Natural Gradient as Variational Inference"☆120Updated 6 years ago
- Understanding normalizing flows☆131Updated 5 years ago
- Second-order optimiser for deep networks☆76Updated 6 years ago
- Implementation of Stochastic Gradient MCMC algorithms☆40Updated 8 years ago
- PyTorch implementation of PathNet: Evolution Channels Gradient Descent in Super Neural Networks☆80Updated 7 years ago
- Implementation of "Variational Dropout and the Local Reparameterization Trick" paper with Pytorch☆50Updated 7 years ago
- Variance Networks: When Expectation Does Not Meet Your Expectations, ICLR 2019☆39Updated 4 years ago
- Implementation of "Learning with Random Learning Rates" in PyTorch.☆102Updated 5 years ago
- Implementation of Coulomb GANs☆62Updated 3 years ago
- Proximal Backpropagation - a neural network training algorithm that takes implicit instead of explicit gradient steps☆41Updated 5 years ago
- Code to reproduce some of the figures in the paper "On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima"☆138Updated 7 years ago
- An implementation of KFAC for TensorFlow☆198Updated 2 years ago
- Implementation of REBAR in PyTorch☆17Updated 6 years ago