Alternatives and similar repositories for kfac

Users that are interested in kfac are comparing it to the libraries listed below

• yaroslavvb / kfac_pytorch
  ☆133Updated 7 years ago
• mariogeiger / hessian
  hessian in pytorch
  ☆187Updated 4 years ago
• duvenaud / relax
  Optimizing control variates for black-box gradient estimation
  ☆163Updated 5 years ago
• uber-research / intrinsic-dimension
  ☆219Updated 7 years ago
• koz4k / dni-pytorch
  Decoupled Neural Interfaces using Synthetic Gradients for PyTorch
  ☆237Updated 6 years ago
• renmengye / tensorflow-forward-ad
  Forward-mode Automatic Differentiation for TensorFlow
  ☆139Updated 7 years ago
• ericjang / maml-jax
  Implementation of Model-Agnostic Meta-Learning (MAML) in Jax
  ☆189Updated 2 years ago
• Thrandis / EKFAC-pytorch
  Repository containing Pytorch code for EKFAC and K-FAC perconditioners.
  ☆143Updated last year
• google-deepmind / symplectic-gradient-adjustment
  A colab that implements the Symplectic Gradient Adjustment optimizer from "The mechanics of n-player differentiable games"
  ☆154Updated 6 years ago
• bamos / setGPU
  Small Python library to automatically set CUDA_VISIBLE_DEVICES to the least loaded device on multi-GPU systems.
  ☆107Updated 2 years ago
• alecwangcq / KFAC-Pytorch
  Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
  ☆132Updated 5 years ago
• google / spectral-density
  Hessian spectral density estimation in TF and Jax
  ☆123Updated 4 years ago
• juliuskunze / jaxnet
  Concise deep learning for JAX
  ☆183Updated 4 years ago
• jotaf98 / curveball
  Second-order optimiser for deep networks
  ☆76Updated 6 years ago
• gbaydin / hypergradient-descent
  Hypergradient descent
  ☆148Updated last year
• amirgholami / anode
  [IJCAI'19, NeurIPS'19] Anode: Unconditionally Accurate Memory-Efficient Gradients for Neural ODEs
  ☆104Updated 4 years ago
• toiaydcdyywlhzvlob / backpack
  This repository is no longer maintained. Check
  ☆81Updated 5 years ago
• eladhoffer / bigBatch
  Code used to generate the results appearing in "Train longer, generalize better: closing the generalization gap in large batch training o…
  ☆149Updated 8 years ago
• google-deepmind / mc_gradients
  ☆168Updated 10 months ago
• brain-research / guided-evolutionary-strategies
  Guided Evolutionary Strategies
  ☆271Updated 2 years ago
• cybertronai / pytorch-sso
  PyTorch-SSO: Scalable Second-Order methods in PyTorch
  ☆146Updated last year
• google-deepmind / spectral_inference_networks
  Implementation of Spectral Inference Networks, ICLR 2019
  ☆172Updated 6 years ago
• amzn / metalearn-leap
  Original PyTorch implementation of the Leap meta-learner (https://arxiv.org/abs/1812.01054) along with code for running the Omniglot expe…
  ☆148Updated 2 years ago
• martius-lab / l4-optimizer
  Code for paper "L4: Practical loss-based stepsize adaptation for deep learning"
  ☆124Updated 6 years ago
• wiseodd / natural-gradients
  Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)
  ☆139Updated 6 years ago
• lezcano / expRNN
  Optimization with orthogonal constraints and on general manifolds
  ☆128Updated 4 years ago
• google-deepmind / jaxline
  ☆157Updated last year
• conormdurkan / autoregressive-energy-machines
  Autoregressive Energy Machines
  ☆78Updated 2 years ago
• gd-zhang / Weight-Decay
  Regularization, Neural Network Training Dynamics
  ☆14Updated 5 years ago
• Bonnevie / rebar
  A Python implementation of the gradient REBAR estimator.
  ☆46Updated 6 years ago