YiwenShaoStephen / NGD-SGD

Related projects ⓘ

Alternatives and complementary repositories for NGD-SGD

• Thrandis / EKFAC-pytorch
  Repository containing Pytorch code for EKFAC and K-FAC perconditioners.
  ☆140Updated last year
• alecwangcq / KFAC-Pytorch
  Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
  ☆127Updated 5 years ago
• wiseodd / natural-gradients
  Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)
  ☆135Updated 5 years ago
• locuslab / edge-of-stability
  ☆59Updated 3 years ago
• AlexanderMath / fasth
  Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.
  ☆69Updated 3 months ago
• logancyang / loss-landscape-anim
  Create animations for the optimization trajectory of neural nets
  ☆137Updated 9 months ago
• fKunstner / limitations-empirical-fisher
  Limitations of the Empirical Fisher Approximation
  ☆45Updated 4 years ago
• gpauloski / kfac-pytorch
  Distributed K-FAC Preconditioner for PyTorch
  ☆80Updated this week
• fdraxler / PyTorch-AutoNEB
  PyTorch AutoNEB implementation to identify minimum energy paths, e.g. in neural network loss landscapes
  ☆54Updated 2 years ago
• tfjgeorge / nngeometry
  {KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch
  ☆206Updated last month
• TrentBrick / PyTorchDiscreteFlows
  Discrete Normalizing Flows implemented in PyTorch
  ☆107Updated 3 years ago
• rajatvd / NTK
  Code for experiments in my blog post on the Neural Tangent Kernel: https://eigentales.com/NTK
  ☆166Updated 5 years ago
• damaru2 / ntk
  NTK reading group
  ☆86Updated 4 years ago
• zhangjiong724 / spectral-RNN
  STABILIZING GRADIENTS FOR DEEP NEURAL NETWORKS VIA EFFICIENT SVD PARAMETERIZATION
  ☆16Updated 6 years ago
• locuslab / monotone_op_net
  Monotone operator equilibrium networks
  ☆51Updated 4 years ago
• lezcano / expRNN
  Optimization with orthogonal constraints and on general manifolds
  ☆126Updated 4 years ago
• asappresearch / flop
  Pytorch library for factorized L0-based pruning.
  ☆43Updated last year
• prolearner / hypertorch
  ☆119Updated 5 months ago
• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆97Updated 4 years ago
• avirmaux / lipEstimation
  ☆57Updated last year
• google / spectral-density
  Hessian spectral density estimation in TF and Jax
  ☆115Updated 4 years ago
• gknilsen / pyhessian
  pyhessian is a TensorFlow module which can be used to estimate Hessian matrices
  ☆23Updated 3 years ago
• my-yy / s2v_rc
  Speech2Vec Reality Check
  ☆75Updated last year
• nicola-decao / power_spherical
  Pytorch implementation of the Power Spherical distribution
  ☆73Updated 3 months ago
• CW-Huang / CP-Flow
  Convex potential flows
  ☆78Updated 2 years ago
• distsup / DistSup
  Representation learning for NLP @ JSALT19
  ☆36Updated 4 years ago
• flaport / torch_eunn
  A Pytorch implementation of an efficient unitary neural network (https://arxiv.org/abs/1612.05231)
  ☆32Updated 4 years ago
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆67Updated last year
• JingtongSu / sanity-checking-pruning
  Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot
  ☆43Updated 4 years ago
• tml-epfl / understanding-sam
  Towards Understanding Sharpness-Aware Minimization [ICML 2022]
  ☆35Updated 2 years ago