Alternatives and similar repositories for natural-gradients

Users that are interested in natural-gradients are comparing it to the libraries listed below

• fwcore / mean-field-theory-deep-learning
  paper lists and information on mean-field theory of deep learning
  ☆78Updated 6 years ago
• ruosongwang / CNTK
  Convolutional Neural Tangent Kernel
  ☆113Updated 5 years ago
• Thrandis / EKFAC-pytorch
  Repository containing Pytorch code for EKFAC and K-FAC perconditioners.
  ☆145Updated 2 years ago
• gbaydin / hypergradient-descent
  Hypergradient descent
  ☆149Updated last year
• djstrouse / information-bottleneck
  a python implementation of various versions of the information bottleneck, including automated parameter searching
  ☆128Updated 5 years ago
• damaru2 / ntk
  NTK reading group
  ☆87Updated 5 years ago
• mariogeiger / hessian
  hessian in pytorch
  ☆187Updated 4 years ago
• microsoft / deterministic-variational-inference
  Sample code for running deterministic variational inference to train Bayesian neural networks
  ☆100Updated 6 years ago
• prolearner / hypertorch
  ☆124Updated last year
• bneyshabur / over-parametrization
  Computing various norms/measures on over-parametrized neural networks
  ☆49Updated 6 years ago
• google / spectral-density
  Hessian spectral density estimation in TF and Jax
  ☆123Updated 4 years ago
• bobby-he / Neural_Tangent_Kernel
  ☆67Updated 6 years ago
• fKunstner / limitations-empirical-fisher
  Limitations of the Empirical Fisher Approximation
  ☆47Updated 5 months ago
• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆105Updated 4 years ago
• artemyk / ibsgd
  ☆152Updated 5 years ago
• rajatvd / NTK
  Code for experiments in my blog post on the Neural Tangent Kernel: https://eigentales.com/NTK
  ☆176Updated 5 years ago
• cybertronai / autograd-hacks
  ☆157Updated 3 years ago
• revbucket / geometric-certificates
  Geometric Certifications of Neural Nets
  ☆42Updated 2 years ago
• google-deepmind / mc_gradients
  ☆169Updated last year
• yaroslavvb / kfac_pytorch
  ☆133Updated 7 years ago
• ganguli-lab / deepchaos
  Experiments for the paper "Exponential expressivity in deep neural networks through transient chaos"
  ☆72Updated 9 years ago
• emtiyaz / vadam
  Code for ICML 2018 paper on "Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in Adam" by Khan, Nielsen, Tangkaratt, Lin, …
  ☆112Updated 6 years ago
• noahgolmant / pytorch-hessian-eigenthings
  Efficient PyTorch Hessian eigendecomposition tools!
  ☆375Updated last year
• cybertronai / pytorch-sso
  PyTorch-SSO: Scalable Second-Order methods in PyTorch
  ☆147Updated last year
• abdulfatir / normalizing-flows
  Understanding normalizing flows
  ☆132Updated 5 years ago
• timgaripov / dnn-mode-connectivity
  Mode Connectivity and Fast Geometric Ensembles in PyTorch
  ☆272Updated 2 years ago
• lezcano / expRNN
  Optimization with orthogonal constraints and on general manifolds
  ☆129Updated 5 years ago
• gknilsen / pyhessian
  pyhessian is a TensorFlow module which can be used to estimate Hessian matrices
  ☆24Updated 4 years ago
• tudor-berariu / fisher-information-matrix
  PyTorch implementation of FIM and empirical FIM
  ☆61Updated 7 years ago
• LMescheder / TheNumericsOfGANs
  This repository contains the code to reproduce the core results from the paper "The Numerics of GANs".
  ☆46Updated 7 years ago