Alternatives and similar repositories for EKFAC-pytorch

Users that are interested in EKFAC-pytorch are comparing it to the libraries listed below

• alecwangcq / KFAC-Pytorch

  View on GitHub
  Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
  ☆132Jul 2, 2019Updated 6 years ago
• yaroslavvb / kfac_pytorch

  View on GitHub
  ☆135Oct 23, 2017Updated 8 years ago
• pomonam / NoisyNaturalGradient

  View on GitHub
  TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".
  ☆60Jan 12, 2019Updated 7 years ago
• fKunstner / limitations-empirical-fisher

  View on GitHub
  Limitations of the Empirical Fisher Approximation
  ☆49Mar 3, 2025Updated 11 months ago
• rgrosse / csc2541_examples

  View on GitHub
  ☆30Feb 11, 2021Updated 5 years ago
• cybertronai / pytorch-sso

  View on GitHub
  PyTorch-SSO: Scalable Second-Order methods in PyTorch
  ☆148Oct 1, 2023Updated 2 years ago
• tensorflow / kfac

  View on GitHub
  An implementation of KFAC for TensorFlow
  ☆199Feb 11, 2022Updated 4 years ago
• f-dangel / backpack

  View on GitHub
  BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.
  ☆604Nov 28, 2025Updated 2 months ago
• gpauloski / kfac-pytorch

  View on GitHub
  Distributed K-FAC preconditioner for PyTorch
  ☆95Updated this week
• f-dangel / hbp

  View on GitHub
  Hessian backpropagation (HBP): PyTorch extension of backpropagation for block-diagonal curvature matrix approximations
  ☆21Mar 25, 2023Updated 2 years ago
• hannakb / KFA

  View on GitHub
  Implementation of the article Online Structured Laplace Approximations For Overcoming Catastrophic Forgetting (https://arxiv.org/pdf/1805…
  ☆10Feb 1, 2019Updated 7 years ago
• PrincetonLIPS / randomized_telescopes

  View on GitHub
  Code for "Efficient optimization of loops and limits with randomized telescoping sums"
  ☆27May 13, 2019Updated 6 years ago
• g-benton / hessian-eff-dim

  View on GitHub
  Public Codebase for Rethinking Parameter Counting: Effective Dimensionality Revisited
  ☆37Dec 27, 2022Updated 3 years ago
• elizabethnewman / hessQuik

  View on GitHub
  Computing gradients and Hessians of feed-forward networks with GPU acceleration
  ☆20Feb 14, 2024Updated last year
• amirgholami / PyHessian

  View on GitHub
  PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks
  ☆773Jul 10, 2025Updated 7 months ago
• tyohei / chainerkfac

  View on GitHub
  A Chainer extension for K-FAC
  ☆20Jun 16, 2019Updated 6 years ago
• gd-zhang / Weight-Decay

  View on GitHub
  Regularization, Neural Network Training Dynamics
  ☆14Jan 13, 2020Updated 6 years ago
• cybertronai / autograd-hacks

  View on GitHub
  ☆159Jun 8, 2022Updated 3 years ago
• wiseodd / natural-gradients

  View on GitHub
  Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)
  ☆142May 26, 2019Updated 6 years ago
• alecwangcq / EigenDamage-Pytorch

  View on GitHub
  Code for "EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis" https://arxiv.org/abs/1905.05934
  ☆113Mar 3, 2020Updated 5 years ago
• 2prime / Numerical-Algorithms

  View on GitHub
  Numerical Experiments
  ☆15Jan 21, 2018Updated 8 years ago
• HaberGroup / SemiImplicitDNNs

  View on GitHub
  Pytorch implementation of 'Semi-Implicit Methods for Deep Neural Networks'
  ☆25May 13, 2019Updated 6 years ago
• cybertronai / autograd-lib

  View on GitHub
  ☆33May 21, 2020Updated 5 years ago
• nrimsky / InfluenceFunctions

  View on GitHub
  Implementation of Influence Function approximations for differently sized ML models, using PyTorch
  ☆16Sep 15, 2023Updated 2 years ago
• noahgolmant / pytorch-hessian-eigenthings

  View on GitHub
  Efficient PyTorch Hessian eigendecomposition tools!
  ☆384Feb 29, 2024Updated last year
• ermongroup / higher_order_invariance

  View on GitHub
  Code for "Accelerating Natural Gradient with Higher-Order Invariance"
  ☆30Jun 28, 2019Updated 6 years ago
• isaacdevlugt / GreNADE

  View on GitHub
  Groundstate Reconstructive Energies using Neural Autoregressive Distribution Estimators (GreNADE)
  ☆10Apr 1, 2022Updated 3 years ago
• nikita-astronaut / nqs_frustrated_phase

  View on GitHub
  ☆10Jan 16, 2020Updated 6 years ago
• lixilinx / psgd_torch

  View on GitHub
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆190Jan 11, 2026Updated last month
• fmeirinhos / pytorch-hessianfree

  View on GitHub
  PyTorch implementation of Hessian Free optimisation
  ☆43Dec 19, 2019Updated 6 years ago
• tfjgeorge / nngeometry

  View on GitHub
  {KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch
  ☆221Updated this week
• asteroidhouse / INN-exploding-inverses

  View on GitHub
  Code for Understanding and Mitigating Exploding Inverses in Invertible Neural Networks (AISTATS 2021) http://arxiv.org/abs/2006.09347
  ☆30Aug 29, 2020Updated 5 years ago
• Chillee / lit-llama

  View on GitHub
  Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code
  ☆10Aug 29, 2023Updated 2 years ago
• csc2541-f17 / csc2541-f17.github.io

  View on GitHub
  ☆12Dec 7, 2017Updated 8 years ago
• frankwswang / QuMGAN.jl

  View on GitHub
  Quantum GAN algorithm based on MPS, realized by Julia.
  ☆11Apr 5, 2019Updated 6 years ago
• jrbtaylor / conditional-pixelcnn

  View on GitHub
  A PyTorch implementation of Conditional PixelCNNs
  ☆27Jan 24, 2018Updated 8 years ago
• hjmshi / PyTorch-LBFGS

  View on GitHub
  A PyTorch implementation of L-BFGS.
  ☆625Feb 21, 2023Updated 2 years ago
• mariushobbhahn / LB_for_BNNs_official

  View on GitHub
  Official repository for the paper "Fast Predictive Uncertainty for Classification with Bayesian Deep Networks". Accepted at UAI 2022. htt…
  ☆12May 25, 2022Updated 3 years ago
• langosco / neural-variational-gradient-descent

  View on GitHub
  Code for the paper 'Neural Variational Gradient Descent'. We perform nonparametric variational inference by transporting samples along a …
  ☆12Jul 29, 2021Updated 4 years ago