Alternatives and similar repositories for natural-gradients

Users that are interested in natural-gradients are comparing it to the libraries listed below

• gbaydin / hypergradient-descent
  Hypergradient descent
  ☆147Updated last year
• mariogeiger / hessian
  hessian in pytorch
  ☆187Updated 5 years ago
• ruosongwang / CNTK
  Convolutional Neural Tangent Kernel
  ☆112Updated 6 years ago
• fwcore / mean-field-theory-deep-learning
  paper lists and information on mean-field theory of deep learning
  ☆78Updated 6 years ago
• Thrandis / EKFAC-pytorch
  Repository containing Pytorch code for EKFAC and K-FAC perconditioners.
  ☆149Updated 2 years ago
• damaru2 / ntk
  NTK reading group
  ☆87Updated 6 years ago
• prolearner / hypertorch
  ☆126Updated last year
• bneyshabur / over-parametrization
  Computing various norms/measures on over-parametrized neural networks
  ☆50Updated 7 years ago
• fKunstner / limitations-empirical-fisher
  Limitations of the Empirical Fisher Approximation
  ☆49Updated 10 months ago
• microsoft / deterministic-variational-inference
  Sample code for running deterministic variational inference to train Bayesian neural networks
  ☆102Updated 7 years ago
• yaroslavvb / kfac_pytorch
  ☆135Updated 8 years ago
• revbucket / geometric-certificates
  Geometric Certifications of Neural Nets
  ☆42Updated 3 years ago
• bobby-he / Neural_Tangent_Kernel
  ☆68Updated 6 years ago
• djstrouse / information-bottleneck
  a python implementation of various versions of the information bottleneck, including automated parameter searching
  ☆131Updated 5 years ago
• emtiyaz / vadam
  Code for ICML 2018 paper on "Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in Adam" by Khan, Nielsen, Tangkaratt, Lin, …
  ☆112Updated 7 years ago
• abdulfatir / normalizing-flows
  Understanding normalizing flows
  ☆132Updated 6 years ago
• google-deepmind / mc_gradients
  ☆172Updated last year
• team-approx-bayes / fromp
  Contains code for the NeurIPS 2020 paper by Pan et al., "Continual Deep Learning by FunctionalRegularisation of Memorable Past"
  ☆44Updated 5 years ago
• toiaydcdyywlhzvlob / backpack
  This repository is no longer maintained. Check
  ☆81Updated 5 years ago
• pawni / BayesByHypernet
  Code for the paper Implicit Weight Uncertainty in Neural Networks
  ☆65Updated 6 years ago
• lrjconan / RBP
  Recurrent Back Propagation, Back Propagation Through Optimization, ICML 2018
  ☆43Updated 7 years ago
• LeoYu / neural-tangent-kernel-UCI
  Testing Nerual Tangent Kernel (NTK) on small UCI datasets
  ☆80Updated 6 years ago
• google / spectral-density
  Hessian spectral density estimation in TF and Jax
  ☆124Updated 5 years ago
• pomonam / NoisyNaturalGradient
  TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".
  ☆60Updated 7 years ago
• cybertronai / pytorch-sso
  PyTorch-SSO: Scalable Second-Order methods in PyTorch
  ☆148Updated 2 years ago
• gd-zhang / noisy-K-FAC
  Natural Gradient, Variational Inference
  ☆29Updated 6 years ago
• ssydasheng / FBNN
  Code for "Functional variational Bayesian neural networks" (https://arxiv.org/abs/1903.05779)
  ☆86Updated 5 years ago
• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆106Updated 5 years ago
• gknilsen / pyhessian
  pyhessian is a TensorFlow module which can be used to estimate Hessian matrices
  ☆25Updated 4 years ago
• asteroidhouse / self-tuning-networks
  Code for Self-Tuning Networks (ICLR 2019) https://arxiv.org/abs/1903.03088
  ☆60Updated 6 years ago