Alternatives and similar repositories for autograd-hacks:

Users that are interested in autograd-hacks are comparing it to the libraries listed below

• noahgolmant / pytorch-hessian-eigenthings
  Efficient PyTorch Hessian eigendecomposition tools!
  ☆373Updated last year
• Thrandis / EKFAC-pytorch
  Repository containing Pytorch code for EKFAC and K-FAC perconditioners.
  ☆142Updated last year
• timgaripov / dnn-mode-connectivity
  Mode Connectivity and Fast Geometric Ensembles in PyTorch
  ☆270Updated 2 years ago
• cybertronai / pytorch-sso
  PyTorch-SSO: Scalable Second-Order methods in PyTorch
  ☆145Updated last year
• alecwangcq / KFAC-Pytorch
  Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
  ☆132Updated 5 years ago
• prolearner / hypertorch
  ☆122Updated 11 months ago
• damaru2 / ntk
  NTK reading group
  ☆88Updated 5 years ago
• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆106Updated 4 years ago
• mariogeiger / hessian
  hessian in pytorch
  ☆187Updated 4 years ago
• ruosongwang / CNTK
  Convolutional Neural Tangent Kernel
  ☆111Updated 5 years ago
• google / spectral-density
  Hessian spectral density estimation in TF and Jax
  ☆123Updated 4 years ago
• avirmaux / lipEstimation
  ☆58Updated 2 years ago
• tfjgeorge / nngeometry
  {KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch
  ☆213Updated 2 weeks ago
• toiaydcdyywlhzvlob / backpack
  This repository is no longer maintained. Check
  ☆81Updated 5 years ago
• kazukiosawa / asdl
  ASDL: Automatic Second-order Differentiation Library for PyTorch
  ☆185Updated 5 months ago
• gbaydin / hypergradient-descent
  Hypergradient descent
  ☆146Updated 11 months ago
• apple / learning-subspaces
  ☆133Updated 4 years ago
• wiseodd / natural-gradients
  Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)
  ☆139Updated 5 years ago
• rajatvd / NTK
  Code for experiments in my blog post on the Neural Tangent Kernel: https://eigentales.com/NTK
  ☆172Updated 5 years ago
• amirgholami / HessianFlow
  ☆83Updated 5 years ago
• cybertronai / autograd-lib
  ☆33Updated 4 years ago
• yaodongyu / Rethink-BiasVariance-Tradeoff
  Rethinking Bias-Variance Trade-off for Generalization of Neural Networks
  ☆49Updated 4 years ago
• ssnl / PyTorch-Reparam-Module
  Reparameterize your PyTorch modules
  ☆71Updated 4 years ago
• wgrathwohl / JEM
  Project site for "Your Classifier is Secretly an Energy-Based Model and You Should Treat it Like One"
  ☆423Updated 2 years ago
• allenai / hidden-networks
  ☆190Updated 4 years ago
• g-benton / loss-surface-simplexes
  ☆99Updated 3 years ago
• cemanil / LNets
  Lipschitz Neural Networks described in "Sorting Out Lipschitz Function Approximation" (ICML 2019).
  ☆55Updated 4 years ago
• AlexanderMath / fasth
  Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.
  ☆75Updated 9 months ago
• uber-research / deconstructing-lottery-tickets
  ☆144Updated 2 years ago
• f-dangel / backpack
  BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.
  ☆580Updated 4 months ago