Alternatives and similar repositories for natural-gradients:

Users that are interested in natural-gradients are comparing it to the libraries listed below

• ruosongwang / CNTK
  Convolutional Neural Tangent Kernel
  ☆108Updated 5 years ago
• fwcore / mean-field-theory-deep-learning
  paper lists and information on mean-field theory of deep learning
  ☆75Updated 5 years ago
• gknilsen / pyhessian
  pyhessian is a TensorFlow module which can be used to estimate Hessian matrices
  ☆24Updated 3 years ago
• mariogeiger / hessian
  hessian in pytorch
  ☆186Updated 4 years ago
• fKunstner / limitations-empirical-fisher
  Limitations of the Empirical Fisher Approximation
  ☆46Updated 4 years ago
• thjashin / spectral-stein-grad
  Code for "A Spectral Approach to Gradient Estimation for Implicit Distributions" (ICML'18)
  ☆32Updated last year
• yaroslavvb / kfac_pytorch
  ☆132Updated 7 years ago
• revbucket / geometric-certificates
  Geometric Certifications of Neural Nets
  ☆41Updated 2 years ago
• ganguli-lab / deepchaos
  Experiments for the paper "Exponential expressivity in deep neural networks through transient chaos"
  ☆70Updated 8 years ago
• damaru2 / ntk
  NTK reading group
  ☆87Updated 5 years ago
• duvenaud / relax
  Optimizing control variates for black-box gradient estimation
  ☆162Updated 5 years ago
• Thrandis / EKFAC-pytorch
  Repository containing Pytorch code for EKFAC and K-FAC perconditioners.
  ☆140Updated last year
• gbaydin / hypergradient-descent
  Hypergradient descent
  ☆143Updated 7 months ago
• google-deepmind / mc_gradients
  ☆163Updated 5 months ago
• bneyshabur / over-parametrization
  Computing various norms/measures on over-parametrized neural networks
  ☆49Updated 6 years ago
• toiaydcdyywlhzvlob / backpack
  This repository is no longer maintained. Check
  ☆81Updated 4 years ago
• locuslab / projected_sinkhorn
  ☆87Updated 5 months ago
• AMLab-Amsterdam / MNF_VBNN
  Multiplicative Normalizing Flow (MNF) posteriors for variational Bayesian neural networks
  ☆65Updated 4 years ago
• YingzhenLi / vae_renyi_divergence
  A tensorflow implementation of VAE training with Renyi divergence
  ☆31Updated 8 years ago
• LMescheder / TheNumericsOfGANs
  This repository contains the code to reproduce the core results from the paper "The Numerics of GANs".
  ☆46Updated 6 years ago
• thjashin / gp-infer-net
  Scalable Training of Inference Networks for Gaussian-Process Models, ICML 2019
  ☆41Updated 2 years ago
• djstrouse / information-bottleneck
  a python implementation of various versions of the information bottleneck, including automated parameter searching
  ☆122Updated 4 years ago
• ermongroup / f-EBM
  Code for "Training Deep Energy-Based Models with f-Divergence Minimization" ICML 2020
  ☆36Updated last year
• google / spectral-density
  Hessian spectral density estimation in TF and Jax
  ☆120Updated 4 years ago
• LeoYu / neural-tangent-kernel-UCI
  Testing Nerual Tangent Kernel (NTK) on small UCI datasets
  ☆83Updated 5 years ago
• ucla-vision / entropy-sgd
  Lua implementation of Entropy-SGD
  ☆81Updated 6 years ago
• ssydasheng / FBNN
  Code for "Functional variational Bayesian neural networks" (https://arxiv.org/abs/1903.05779)
  ☆80Updated 4 years ago
• lrjconan / RBP
  Recurrent Back Propagation, Back Propagation Through Optimization, ICML 2018
  ☆41Updated 6 years ago
• asteroidhouse / self-tuning-networks
  Code for Self-Tuning Networks (ICLR 2019) https://arxiv.org/abs/1903.03088
  ☆53Updated 5 years ago
• microsoft / deterministic-variational-inference
  Sample code for running deterministic variational inference to train Bayesian neural networks
  ☆100Updated 6 years ago