Alternatives and similar repositories for kfac-pytorch

Users that are interested in kfac-pytorch are comparing it to the libraries listed below

• alecwangcq / KFAC-Pytorch
  Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
  ☆132Updated 5 years ago
• AlexanderMath / fasth
  Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.
  ☆75Updated 10 months ago
• n-gao / pytorch-kfac
  Pytorch implementation of KFAC - this is a port of https://github.com/tensorflow/kfac/
  ☆25Updated 11 months ago
• fKunstner / limitations-empirical-fisher
  Limitations of the Empirical Fisher Approximation
  ☆47Updated 3 months ago
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆66Updated last year
• kazukiosawa / asdl
  ASDL: Automatic Second-order Differentiation Library for PyTorch
  ☆187Updated 6 months ago
• Thrandis / EKFAC-pytorch
  Repository containing Pytorch code for EKFAC and K-FAC perconditioners.
  ☆143Updated last year
• JunLi-Galios / Optimization-on-Stiefel-Manifold-via-Cayley-Transform
  Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform
  ☆40Updated 6 years ago
• tensorly / torch
  TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch
  ☆77Updated 11 months ago
• HazyResearch / butterfly
  Butterfly matrix multiplication in PyTorch
  ☆168Updated last year
• spcl / sten
  Sparsity support for PyTorch
  ☆35Updated 2 months ago
• fmeirinhos / pytorch-hessianfree
  PyTorch implementation of Hessian Free optimisation
  ☆43Updated 5 years ago
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆62Updated 4 years ago
• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆105Updated 4 years ago
• bobby-he / Neural_Tangent_Kernel
  ☆67Updated 6 years ago
• locuslab / edge-of-stability
  ☆67Updated 5 months ago
• tyohei / chainerkfac
  A Chainer extension for K-FAC
  ☆20Updated 5 years ago
• f-dangel / hbp
  Hessian backpropagation (HBP): PyTorch extension of backpropagation for block-diagonal curvature matrix approximations
  ☆20Updated 2 years ago
• zoq / Awesome-Optimizer
  Collect optimizer related papers, data, repositories
  ☆91Updated 6 months ago
• google / spectral-density
  Hessian spectral density estimation in TF and Jax
  ☆123Updated 4 years ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆175Updated this week
• hendrydong / NTK-and-MF-examples
  Visualization of mean field and neural tangent kernel regime
  ☆20Updated 10 months ago
• mccrearyd / rigl-torch
  Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.
  ☆56Updated 3 years ago
• pfnet-research / einconv
  ☆47Updated 5 years ago
• IST-DASLab / WoodFisher
  Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)
  ☆52Updated 4 years ago
• lzhangbv / eva
  [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation
  ☆12Updated last year
• cybertronai / pytorch-sso
  PyTorch-SSO: Scalable Second-Order methods in PyTorch
  ☆146Updated last year
• f-dangel / singd
  [ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)
  ☆22Updated 7 months ago
• f-dangel / curvlinops
  PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)
  ☆38Updated last month
• hushon / JAX-ResNet-CIFAR10
  Simple CIFAR10 ResNet example with JAX.
  ☆23Updated 4 years ago