Alternatives and similar repositories for singd:

Users that are interested in singd are comparing it to the libraries listed below

• f-dangel / vivit
  [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…
  ☆17Updated last year
• fKunstner / noise-sgd-adam-sign
  ☆15Updated last year
• f-dangel / sirfshampoo
  [ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)
  ☆14Updated 2 months ago
• f-dangel / curvlinops
  PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)
  ☆25Updated 2 weeks ago
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆44Updated 2 years ago
• AlexanderMath / fasth
  Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.
  ☆72Updated 6 months ago
• evanatyourservice / kron_torch
  An implementation of PSGD Kron second-order optimizer for PyTorch
  ☆29Updated 3 weeks ago
• ermongroup / fast_feedforward_computation
  Official code for "Accelerating Feedforward Computation via Parallel Nonlinear Equation Solving", ICML 2021
  ☆27Updated 3 years ago
• tml-epfl / sgd-sparse-features
  SGD with large step sizes learns sparse features [ICML 2023]
  ☆32Updated last year
• locuslab / orthogonal-convolutions
  Implementations of orthogonal and semi-orthogonal convolutions in the Fourier domain with applications to adversarial robustness
  ☆43Updated 3 years ago
• team-approx-bayes / bayesian-sam
  Code for "SAM as an Optimal Relaxation of Bayes", ICLR 2023.
  ☆24Updated last year
• shikaiqiu / compute-better-spent
  ☆50Updated 3 months ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆154Updated last month
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆59Updated 4 months ago
• nick11roberts / XD
  ☆11Updated 2 years ago
• gortizji / linearized-networks
  Source code of "What can linearized neural networks actually say about generalization?
  ☆20Updated 3 years ago
• facebookresearch / w2ot
  Euclidean Wasserstein-2 optimal transportation
  ☆44Updated last year
• andres-fr / skerch
  Sketched matrix decompositions for PyTorch
  ☆69Updated this week
• locuslab / edge-of-stability
  ☆63Updated last month
• SaitejaUtpala / rieoptax
  Riemannian Optimization Using JAX
  ☆48Updated last year
• locuslab / monotone_op_net
  Monotone operator equilibrium networks
  ☆51Updated 4 years ago
• gisilvs / AEF
  ☆33Updated last year
• epfml / REQ
  ☆16Updated 7 months ago
• YannDubs / Invariant-Self-Supervised-Learning
  Pytorch code for "Improving Self-Supervised Learning by Characterizing Idealized Representations"
  ☆40Updated 2 years ago
• Sanaelotfi / Bayesian_model_comparison
  Supporing code for the paper "Bayesian Model Selection, the Marginal Likelihood, and Generalization".
  ☆35Updated 2 years ago
• AndPotap / einsum-search
  ☆29Updated 3 months ago
• wiseodd / laplace-bayesopt
  Laplace approximated BNN surrogate for BoTorch
  ☆8Updated 2 months ago
• google-deepmind / eigengame
  Open source code for EigenGame.
  ☆30Updated last year
• NingMiao / InstaAug
  ☆13Updated 2 years ago
• CW-Huang / CP-Flow
  Convex potential flows
  ☆82Updated 3 years ago