Alternatives and similar repositories for NGD-SGD:

Users that are interested in NGD-SGD are comparing it to the libraries listed below

• Thrandis / EKFAC-pytorch
  Repository containing Pytorch code for EKFAC and K-FAC perconditioners.
  ☆140Updated last year
• toshas / torch-discounted-cumsum
  Fast Discounted Cumulative Sums in PyTorch
  ☆95Updated 3 years ago
• alecwangcq / KFAC-Pytorch
  Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
  ☆130Updated 5 years ago
• f-dangel / sirfshampoo
  [ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)
  ☆14Updated 2 months ago
• wiseodd / natural-gradients
  Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)
  ☆136Updated 5 years ago
• Cerebras / online-normalization
  Online Normalization for Training Neural Networks (Companion Repository)
  ☆79Updated 3 years ago
• gcambara / cape
  Continuous Augmented Positional Embeddings (CAPE) implementation for PyTorch
  ☆39Updated 2 years ago
• prolearner / hypertorch
  ☆120Updated 7 months ago
• gpauloski / kfac-pytorch
  Distributed K-FAC Preconditioner for PyTorch
  ☆84Updated this week
• fdraxler / PyTorch-AutoNEB
  PyTorch AutoNEB implementation to identify minimum energy paths, e.g. in neural network loss landscapes
  ☆54Updated 2 years ago
• nicola-decao / power_spherical
  Pytorch implementation of the Power Spherical distribution
  ☆74Updated 5 months ago
• iamyuanchung / VQ-APC
  Vector Quantized Autoregressive Predictive Coding (VQ-APC)
  ☆35Updated 4 years ago
• NicolasZucchet / minimal-LRU
  Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)
  ☆51Updated 2 months ago
• google / spectral-density
  Hessian spectral density estimation in TF and Jax
  ☆120Updated 4 years ago
• renqianluo / GBDT-NAS
  GBDT-NAS
  ☆28Updated 3 years ago
• L0SG / NanoFlow
  PyTorch implementation of the paper "NanoFlow: Scalable Normalizing Flows with Sublinear Parameter Complexity." (NeurIPS 2020)
  ☆64Updated 4 years ago
• AlexanderMath / fasth
  Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.
  ☆72Updated 5 months ago
• Separius / CudaRelativeAttention
  custom cuda kernel for {2, 3}d relative attention with pytorch wrapper
  ☆43Updated 4 years ago
• logancyang / loss-landscape-anim
  Create animations for the optimization trajectory of neural nets
  ☆144Updated 11 months ago
• my-yy / s2v_rc
  Speech2Vec Reality Check
  ☆79Updated last year
• harvardnlp / genbmm
  CUDA kernels for generalized matrix-multiplication in PyTorch
  ☆79Updated 3 years ago
• aced125 / sparsemax
  A PyTorch Implementation of the Sparsemax operator (https://arxiv.org/pdf/1803.09820.pdf)
  ☆31Updated 2 years ago
• JunLi-Galios / Optimization-on-Stiefel-Manifold-via-Cayley-Transform
  Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform
  ☆37Updated 5 years ago
• revsic / jax-variational-diffwave
  Jax/Flax implementation of Variational-DiffWave.
  ☆40Updated 2 years ago
• microsoft / ReinMax
  Beyond Straight-Through
  ☆93Updated last year
• CW-Huang / CP-Flow
  Convex potential flows
  ☆81Updated 3 years ago
• vadimkantorov / ctc
  Primer on CTC implementation in pure Python PyTorch code
  ☆100Updated 5 months ago
• davda54 / ada-hessian
  Easy-to-use AdaHessian optimizer (PyTorch)
  ☆77Updated 4 years ago
• avirmaux / lipEstimation
  ☆57Updated last year
• bshall / VectorQuantizedVAE
  A PyTorch implementation of "Continuous Relaxation Training of Discrete Latent Variable Image Models"
  ☆73Updated 4 years ago