Alternatives and similar repositories for singd

Users that are interested in singd are comparing it to the libraries listed below

• fKunstner / noise-sgd-adam-sign
  ☆16Updated 2 years ago
• f-dangel / vivit
  [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…
  ☆17Updated last year
• f-dangel / sirfshampoo
  [ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)
  ☆14Updated 7 months ago
• shikaiqiu / compute-better-spent
  ☆53Updated 8 months ago
• f-dangel / curvlinops
  PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)
  ☆38Updated last month
• AndPotap / einsum-search
  ☆32Updated 8 months ago
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆45Updated 2 years ago
• team-approx-bayes / bayesian-sam
  Code for "SAM as an Optimal Relaxation of Bayes", ICLR 2023.
  ☆25Updated last year
• epfml / REQ
  ☆17Updated 11 months ago
• gortizji / linearized-networks
  Source code of "What can linearized neural networks actually say about generalization?
  ☆20Updated 3 years ago
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆66Updated 8 months ago
• AlexanderMath / fasth
  Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.
  ☆75Updated 10 months ago
• glassroom / heinsen_attention
  Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)
  ☆24Updated 11 months ago
• ZQZCalin / trainit
  ☆10Updated last month
• f-dangel / einconv
  Convolutions and more as einsum for PyTorch
  ☆16Updated last year
• wiseodd / laplace-bayesopt
  Laplace approximated BNN surrogate for BoTorch
  ☆8Updated 6 months ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆175Updated this week
• YannDubs / Invariant-Self-Supervised-Learning
  Pytorch code for "Improving Self-Supervised Learning by Characterizing Idealized Representations"
  ☆41Updated 2 years ago
• gregorbachmann / scaling_mlps
  ☆51Updated 11 months ago
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆30Updated last year
• nick11roberts / XD
  ☆12Updated 2 years ago
• facebookresearch / semi-discrete-flow
  code for "Semi-Discrete Normalizing Flows through Differentiable Tessellation"
  ☆26Updated 2 years ago
• tml-epfl / sgd-sparse-features
  SGD with large step sizes learns sparse features [ICML 2023]
  ☆32Updated 2 years ago
• tml-epfl / sharpness-vs-generalization
  A modern look at the relationship between sharpness and generalization [ICML 2023]
  ☆43Updated last year
• ermongroup / fast_feedforward_computation
  Official code for "Accelerating Feedforward Computation via Parallel Nonlinear Equation Solving", ICML 2021
  ☆27Updated 3 years ago
• locuslab / orthogonal-convolutions
  Implementations of orthogonal and semi-orthogonal convolutions in the Fourier domain with applications to adversarial robustness
  ☆45Updated 4 years ago
• minyoungg / overparam
  ☆41Updated 2 years ago
• hendrydong / NTK-and-MF-examples
  Visualization of mean field and neural tangent kernel regime
  ☆20Updated 10 months ago
• Sanaelotfi / Bayesian_model_comparison
  Supporing code for the paper "Bayesian Model Selection, the Marginal Likelihood, and Generalization".
  ☆35Updated 2 years ago
• gisilvs / AEF
  ☆33Updated 2 years ago