Alternatives and similar repositories for kfac-pytorch

Users that are interested in kfac-pytorch are comparing it to the libraries listed below

• alecwangcq / KFAC-Pytorch
  Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
  ☆132Updated 6 years ago
• JunLi-Galios / Optimization-on-Stiefel-Manifold-via-Cayley-Transform
  Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform
  ☆43Updated 6 years ago
• AlexanderMath / fasth
  Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.
  ☆77Updated last year
• kazukiosawa / asdl
  ASDL: Automatic Second-order Differentiation Library for PyTorch
  ☆190Updated last year
• Thrandis / EKFAC-pytorch
  Repository containing Pytorch code for EKFAC and K-FAC perconditioners.
  ☆148Updated 2 years ago
• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆106Updated 5 years ago
• cybertronai / pytorch-sso
  PyTorch-SSO: Scalable Second-Order methods in PyTorch
  ☆148Updated 2 years ago
• orobix / fwdgrad
  Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch
  ☆114Updated 2 years ago
• n-gao / pytorch-kfac
  Pytorch implementation of KFAC - this is a port of https://github.com/tensorflow/kfac/
  ☆30Updated last year
• rgrosse / csc2541_examples
  ☆30Updated 4 years ago
• HazyResearch / butterfly
  Butterfly matrix multiplication in PyTorch
  ☆177Updated 2 years ago
• bobby-he / Neural_Tangent_Kernel
  ☆68Updated 6 years ago
• locuslab / edge-of-stability
  ☆73Updated last year
• tfjgeorge / nngeometry
  {KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch
  ☆216Updated last week
• fKunstner / limitations-empirical-fisher
  Limitations of the Empirical Fisher Approximation
  ☆49Updated 9 months ago
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆67Updated 2 years ago
• amirgholami / adahessian
  ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning
  ☆281Updated 2 years ago
• google-research / jaxpruner
  ☆234Updated 9 months ago
• google / spectral-density
  Hessian spectral density estimation in TF and Jax
  ☆124Updated 5 years ago
• logancyang / loss-landscape-anim
  Create animations for the optimization trajectory of neural nets
  ☆161Updated last year
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆63Updated 4 years ago
• amirgholami / HessianFlow
  ☆83Updated 5 years ago
• fwcore / mean-field-theory-deep-learning
  paper lists and information on mean-field theory of deep learning
  ☆78Updated 6 years ago
• topal-team / rockmate
  ☆36Updated 11 months ago
• ruosongwang / CNTK
  Convolutional Neural Tangent Kernel
  ☆112Updated 6 years ago
• fmeirinhos / pytorch-hessianfree
  PyTorch implementation of Hessian Free optimisation
  ☆43Updated 5 years ago
• locuslab / monotone_op_net
  Monotone operator equilibrium networks
  ☆54Updated 5 years ago
• davda54 / ada-hessian
  Easy-to-use AdaHessian optimizer (PyTorch)
  ☆79Updated 5 years ago
• hendrydong / NTK-and-MF-examples
  Visualization of mean field and neural tangent kernel regime
  ☆21Updated last year
• JingtongSu / sanity-checking-pruning
  Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot
  ☆42Updated 5 years ago