Alternatives and similar repositories for natural-gradients:

Users that are interested in natural-gradients are comparing it to the libraries listed below

• Thrandis / EKFAC-pytorch
  Repository containing Pytorch code for EKFAC and K-FAC perconditioners.
  ☆142Updated last year
• fwcore / mean-field-theory-deep-learning
  paper lists and information on mean-field theory of deep learning
  ☆74Updated 6 years ago
• ruosongwang / CNTK
  Convolutional Neural Tangent Kernel
  ☆111Updated 5 years ago
• gbaydin / hypergradient-descent
  Hypergradient descent
  ☆146Updated 11 months ago
• yaroslavvb / kfac_pytorch
  ☆133Updated 7 years ago
• microsoft / deterministic-variational-inference
  Sample code for running deterministic variational inference to train Bayesian neural networks
  ☆100Updated 6 years ago
• google-deepmind / mc_gradients
  ☆166Updated 9 months ago
• gknilsen / pyhessian
  pyhessian is a TensorFlow module which can be used to estimate Hessian matrices
  ☆24Updated 4 years ago
• fKunstner / limitations-empirical-fisher
  Limitations of the Empirical Fisher Approximation
  ☆47Updated 2 months ago
• mariogeiger / hessian
  hessian in pytorch
  ☆187Updated 4 years ago
• damaru2 / ntk
  NTK reading group
  ☆88Updated 5 years ago
• abdulfatir / normalizing-flows
  Understanding normalizing flows
  ☆132Updated 5 years ago
• toiaydcdyywlhzvlob / backpack
  This repository is no longer maintained. Check
  ☆81Updated 5 years ago
• thjashin / spectral-stein-grad
  Code for "A Spectral Approach to Gradient Estimation for Implicit Distributions" (ICML'18)
  ☆33Updated last year
• pawni / BayesByHypernet
  Code for the paper Implicit Weight Uncertainty in Neural Networks
  ☆65Updated 5 years ago
• alecwangcq / KFAC-Pytorch
  Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
  ☆132Updated 5 years ago
• cybertronai / pytorch-sso
  PyTorch-SSO: Scalable Second-Order methods in PyTorch
  ☆145Updated last year
• AMLab-Amsterdam / MNF_VBNN
  Multiplicative Normalizing Flow (MNF) posteriors for variational Bayesian neural networks
  ☆65Updated 4 years ago
• bneyshabur / over-parametrization
  Computing various norms/measures on over-parametrized neural networks
  ☆49Updated 6 years ago
• ucla-vision / entropy-sgd
  Lua implementation of Entropy-SGD
  ☆82Updated 7 years ago
• emtiyaz / vadam
  Code for ICML 2018 paper on "Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in Adam" by Khan, Nielsen, Tangkaratt, Lin, …
  ☆113Updated 6 years ago
• cybertronai / autograd-hacks
  ☆157Updated 2 years ago
• ganguli-lab / deepchaos
  Experiments for the paper "Exponential expressivity in deep neural networks through transient chaos"
  ☆71Updated 8 years ago
• prolearner / hypertorch
  ☆122Updated 11 months ago
• fKunstner / fast-individual-gradients-with-autodiff
  ☆26Updated 6 years ago
• lrjconan / RBP
  Recurrent Back Propagation, Back Propagation Through Optimization, ICML 2018
  ☆41Updated 6 years ago
• ssydasheng / FBNN
  Code for "Functional variational Bayesian neural networks" (https://arxiv.org/abs/1903.05779)
  ☆84Updated 4 years ago
• conormdurkan / autoregressive-energy-machines
  Autoregressive Energy Machines
  ☆77Updated 2 years ago
• pomonam / NoisyNaturalGradient
  TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".
  ☆60Updated 6 years ago
• riannevdberg / sylvester-flows
  ☆180Updated 5 years ago