Alternatives and similar repositories for fwdgrad

Users that are interested in fwdgrad are comparing it to the libraries listed below

• gpauloski / kfac-pytorch
  Distributed K-FAC preconditioner for PyTorch
  ☆91Updated last week
• verbiiyo / rigl-torch
  Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.
  ☆60Updated 3 years ago
• logancyang / loss-landscape-anim
  Create animations for the optimization trajectory of neural nets
  ☆159Updated last year
• HazyResearch / fly
  ☆219Updated 2 years ago
• JunLi-Galios / Optimization-on-Stiefel-Manifold-via-Cayley-Transform
  Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform
  ☆43Updated 6 years ago
• google-research / jaxpruner
  ☆234Updated 8 months ago
• HazyResearch / butterfly
  Butterfly matrix multiplication in PyTorch
  ☆174Updated 2 years ago
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆67Updated 2 years ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆188Updated last week
• bobby-he / Neural_Tangent_Kernel
  ☆67Updated 6 years ago
• tfjgeorge / nngeometry
  {KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch
  ☆215Updated last month
• DSL-Lab / GRBM
  Gaussian-Bernoulli Restricted Boltzmann Machines
  ☆105Updated 2 years ago
• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆104Updated 5 years ago
• locuslab / edge-of-stability
  ☆71Updated 10 months ago
• omihub777 / MLP-Mixer-CIFAR
  PyTorch implementation of Mixer-nano (#parameters is 0.67M, originally Mixer-S/16 has 18M) with 90.83 % acc. on CIFAR-10. Training from s…
  ☆36Updated 3 years ago
• kazukiosawa / asdl
  ASDL: Automatic Second-order Differentiation Library for PyTorch
  ☆190Updated 10 months ago
• alecwangcq / KFAC-Pytorch
  Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
  ☆131Updated 6 years ago
• Johswald / awesome-hypernetworks
  ☆65Updated 3 years ago
• amirgholami / adahessian
  ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning
  ☆281Updated 2 years ago
• tensorly / torch
  TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch
  ☆80Updated last year
• hyeon95y / SparseLinear
  A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently
  ☆51Updated last year
• KellerJordan / REPAIR
  Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair
  ☆50Updated last year
• allenai / hidden-networks
  ☆193Updated 4 years ago
• rajatvd / NTK
  Code for experiments in my blog post on the Neural Tangent Kernel: https://eigentales.com/NTK
  ☆176Updated 5 years ago
• AlexanderMath / fasth
  Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.
  ☆76Updated last year
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆54Updated 4 months ago
• ischlag / fast-weight-transformers
  Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.
  ☆105Updated 4 years ago
• IST-DASLab / WoodFisher
  Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)
  ☆53Updated 4 years ago
• ml-research / rational_activations
  Rational Activation Functions - Replacing Padé Activation Units
  ☆102Updated 7 months ago
• artur-deluca / landscapeviz
  Visualizing the the loss landscape of Fully-Connected Neural Networks
  ☆46Updated 2 years ago