Alternatives and similar repositories for fwdgrad

Users that are interested in fwdgrad are comparing it to the libraries listed below

• gpauloski / kfac-pytorch
  Distributed K-FAC preconditioner for PyTorch
  ☆89Updated last week
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆179Updated this week
• logancyang / loss-landscape-anim
  Create animations for the optimization trajectory of neural nets
  ☆158Updated last year
• HazyResearch / fly
  ☆210Updated 2 years ago
• tfjgeorge / nngeometry
  {KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch
  ☆215Updated 2 months ago
• HazyResearch / butterfly
  Butterfly matrix multiplication in PyTorch
  ☆174Updated last year
• kazukiosawa / asdl
  ASDL: Automatic Second-order Differentiation Library for PyTorch
  ☆189Updated 8 months ago
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆67Updated last year
• google-research / jaxpruner
  ☆233Updated 6 months ago
• JunLi-Galios / Optimization-on-Stiefel-Manifold-via-Cayley-Transform
  Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform
  ☆42Updated 6 years ago
• lightonai / dfa-scales-to-modern-deep-learning
  Study on the applicability of Direct Feedback Alignment to neural view synthesis, recommender systems, geometric learning, and natural la…
  ☆90Updated 3 years ago
• AlexanderMath / fasth
  Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.
  ☆76Updated last year
• alecwangcq / KFAC-Pytorch
  Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
  ☆132Updated 6 years ago
• tensorly / torch
  TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch
  ☆80Updated last year
• verbiiyo / rigl-torch
  Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.
  ☆57Updated 3 years ago
• locuslab / edge-of-stability
  ☆70Updated 8 months ago
• zoq / Awesome-Optimizer
  Collect optimizer related papers, data, repositories
  ☆97Updated 9 months ago
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆187Updated last year
• Johswald / awesome-hypernetworks
  ☆65Updated 3 years ago
• johnryan465 / pscan
  ☆40Updated last year
• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆105Updated 5 years ago
• amirgholami / adahessian
  ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning
  ☆277Updated 2 years ago
• ml-research / rational_activations
  Rational Activation Functions - Replacing Padé Activation Units
  ☆94Updated 5 months ago
• loeweX / Forward-Forward
  Reimplementation of Geoffrey Hinton's Forward-Forward Algorithm
  ☆155Updated last year
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆125Updated last year
• KhrulkovV / tt-pytorch
  ☆60Updated 5 years ago
• hyeon95y / SparseLinear
  A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently
  ☆51Updated last year
• chrhenning / hypnettorch
  Package for working with hypernetworks in PyTorch.
  ☆129Updated last year
• DSL-Lab / GRBM
  Gaussian-Bernoulli Restricted Boltzmann Machines
  ☆104Updated 2 years ago
• google-deepmind / eigengame
  Open source code for EigenGame.
  ☆30Updated 2 years ago