Alternatives and similar repositories for kfac-pytorch:

Users that are interested in kfac-pytorch are comparing it to the libraries listed below

• alecwangcq / KFAC-Pytorch
  Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
  ☆130Updated 5 years ago
• AlexanderMath / fasth
  Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.
  ☆72Updated 6 months ago
• n-gao / pytorch-kfac
  Pytorch implementation of KFAC - this is a port of https://github.com/tensorflow/kfac/
  ☆22Updated 8 months ago
• kazukiosawa / asdl
  ASDL: Automatic Second-order Differentiation Library for PyTorch
  ☆182Updated 2 months ago
• HazyResearch / butterfly
  Butterfly matrix multiplication in PyTorch
  ☆166Updated last year
• Thrandis / EKFAC-pytorch
  Repository containing Pytorch code for EKFAC and K-FAC perconditioners.
  ☆141Updated last year
• fKunstner / limitations-empirical-fisher
  Limitations of the Empirical Fisher Approximation
  ☆47Updated 4 years ago
• tyohei / chainerkfac
  A Chainer extension for K-FAC
  ☆20Updated 5 years ago
• rgrosse / csc2541_examples
  ☆29Updated 4 years ago
• f-dangel / hbp
  Hessian backpropagation (HBP): PyTorch extension of backpropagation for block-diagonal curvature matrix approximations
  ☆20Updated last year
• locuslab / edge-of-stability
  ☆63Updated 2 months ago
• topal-team / rockmate
  ☆35Updated 2 months ago
• spcl / sten
  Sparsity support for PyTorch
  ☆33Updated this week
• bobby-he / Neural_Tangent_Kernel
  ☆67Updated 5 years ago
• JunLi-Galios / Optimization-on-Stiefel-Manifold-via-Cayley-Transform
  Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform
  ☆37Updated 5 years ago
• tensorly / torch
  TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch
  ☆76Updated 8 months ago
• n2cholas / jax-resnet
  Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).
  ☆106Updated 2 years ago
• google-deepmind / kfac-jax
  Second Order Optimization and Curvature Estimation with K-FAC in JAX.
  ☆263Updated last week
• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆104Updated 4 years ago
• akshayka / hessian_trace_estimation
  Hessian trace estimation using PyTorch and Hutch++
  ☆19Updated 4 years ago
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆66Updated last year
• davda54 / ada-hessian
  Easy-to-use AdaHessian optimizer (PyTorch)
  ☆77Updated 4 years ago
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆48Updated 9 months ago
• lzhangbv / eva
  [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation
  ☆12Updated last year
• orobix / fwdgrad
  Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch
  ☆108Updated last year
• fmeirinhos / pytorch-hessianfree
  PyTorch implementation of Hessian Free optimisation
  ☆43Updated 5 years ago
• nick11roberts / XD
  ☆11Updated 2 years ago
• hushon / JAX-ResNet-CIFAR10
  Simple CIFAR10 ResNet example with JAX.
  ☆23Updated 3 years ago
• cybertronai / autograd-hacks
  ☆156Updated 2 years ago
• f-dangel / curvlinops
  PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)
  ☆27Updated this week