Alternatives and similar repositories for kfac:

Users that are interested in kfac are comparing it to the libraries listed below

• yaroslavvb / kfac_pytorch
  ☆133Updated 7 years ago
• uber-research / intrinsic-dimension
  ☆219Updated 6 years ago
• mariogeiger / hessian
  hessian in pytorch
  ☆187Updated 4 years ago
• google-deepmind / mc_gradients
  ☆166Updated 9 months ago
• renmengye / tensorflow-forward-ad
  Forward-mode Automatic Differentiation for TensorFlow
  ☆139Updated 7 years ago
• google-deepmind / spectral_inference_networks
  Implementation of Spectral Inference Networks, ICLR 2019
  ☆171Updated 5 years ago
• juliuskunze / jaxnet
  Concise deep learning for JAX
  ☆183Updated 4 years ago
• alecwangcq / KFAC-Pytorch
  Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
  ☆132Updated 5 years ago
• toiaydcdyywlhzvlob / backpack
  This repository is no longer maintained. Check
  ☆81Updated 5 years ago
• jotaf98 / curveball
  Second-order optimiser for deep networks
  ☆76Updated 6 years ago
• gbaydin / hypergradient-descent
  Hypergradient descent
  ☆146Updated 11 months ago
• google-deepmind / symplectic-gradient-adjustment
  A colab that implements the Symplectic Gradient Adjustment optimizer from "The mechanics of n-player differentiable games"
  ☆154Updated 6 years ago
• Thrandis / EKFAC-pytorch
  Repository containing Pytorch code for EKFAC and K-FAC perconditioners.
  ☆142Updated last year
• ericjang / maml-jax
  Implementation of Model-Agnostic Meta-Learning (MAML) in Jax
  ☆189Updated 2 years ago
• koz4k / dni-pytorch
  Decoupled Neural Interfaces using Synthetic Gradients for PyTorch
  ☆237Updated 6 years ago
• fsschneider / DeepOBS
  DeepOBS: A Deep Learning Optimizer Benchmark Suite
  ☆106Updated last year
• conormdurkan / autoregressive-energy-machines
  Autoregressive Energy Machines
  ☆77Updated 2 years ago
• martius-lab / l4-optimizer
  Code for paper "L4: Practical loss-based stepsize adaptation for deep learning"
  ☆125Updated 6 years ago
• cybertronai / pytorch-sso
  PyTorch-SSO: Scalable Second-Order methods in PyTorch
  ☆145Updated last year
• ucla-vision / entropy-sgd
  Lua implementation of Entropy-SGD
  ☆82Updated 7 years ago
• wiseodd / natural-gradients
  Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)
  ☆139Updated 5 years ago
• alecwangcq / EigenDamage-Pytorch
  Code for "EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis" https://arxiv.org/abs/1905.05934
  ☆112Updated 5 years ago
• fwcore / mean-field-theory-deep-learning
  paper lists and information on mean-field theory of deep learning
  ☆74Updated 6 years ago
• rahulkidambi / AccSGD
  Implements pytorch code for the Accelerated SGD algorithm.
  ☆215Updated 7 years ago
• duvenaud / relax
  Optimizing control variates for black-box gradient estimation
  ☆163Updated 5 years ago
• fKunstner / limitations-empirical-fisher
  Limitations of the Empirical Fisher Approximation
  ☆47Updated 2 months ago
• kirthevasank / nasbot
  Neural Architecture Search with Bayesian Optimisation and Optimal Transport
  ☆133Updated 6 years ago
• ruosongwang / CNTK
  Convolutional Neural Tangent Kernel
  ☆111Updated 5 years ago
• pomonam / NoisyNaturalGradient
  TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".
  ☆60Updated 6 years ago
• cybertronai / autograd-hacks
  ☆157Updated 2 years ago