Alternatives and similar repositories for top-sgd:

Users that are interested in top-sgd are comparing it to the libraries listed below

• facebookresearch / w2ot
  Euclidean Wasserstein-2 optimal transportation
  ☆47Updated last year
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆36Updated 2 years ago
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆36Updated 2 years ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆174Updated this week
• shikaiqiu / compute-better-spent
  ☆53Updated 7 months ago
• radarFudan / mamba-minimal-jax
  ☆30Updated 5 months ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆123Updated last year
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆45Updated 2 years ago
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆60Updated last year
• google-deepmind / dks
  Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…
  ☆70Updated last week
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆66Updated 7 months ago
• bremen79 / parameterfree
  Parameter-Free Optimizers for Pytorch
  ☆126Updated last year
• vvvm23 / mezo-jax
  JAX implementation of "Fine-Tuning Language Models with Just Forward Passes"
  ☆19Updated last year
• evanatyourservice / psgd_jax
  Implementation of PSGD optimizer in JAX
  ☆33Updated 4 months ago
• MichaelArbel / GeneralizedEBM
  ☆53Updated 9 months ago
• AndPotap / einsum-search
  ☆32Updated 7 months ago
• AllanYangZhou / universal_neural_functional
  ☆49Updated last year
• activatedgeek / tight-pac-bayes
  Code for PAC-Bayes Compression Bounds So Tight That They Can Explain Generalization, NeurIPS 2022
  ☆15Updated 2 years ago
• facebookresearch / projUNN
  Fast training of unitary deep network layers from low-rank updates
  ☆28Updated 2 years ago
• smonsays / metax
  flexible meta-learning in jax
  ☆13Updated last year
• AhmedImtiazPrio / grok-adversarial
  Deep Networks Grok All the Time and Here is Why
  ☆34Updated 11 months ago
• cgarciae / nanoGPT-jax
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆33Updated last year
• phlippe / jax_trainer
  Lightning-like training API for JAX with Flax
  ☆38Updated 5 months ago
• tristandeleu / jax-meta-learning
  A collection of meta-learning algorithms in Jax
  ☆23Updated 2 years ago
• riverstone496 / awesome-second-order-optimization
  ☆26Updated last year
• izmailovpavel / neurips_bdl_starter_kit
  ☆18Updated last year
• gregorbachmann / scaling_mlps
  ☆51Updated 11 months ago
• fKunstner / noise-sgd-adam-sign
  ☆16Updated 2 years ago
• rahul13ramesh / compositional_capabilities
  Compositional Capabilities of Autoregressive Transformers: A Study on Synthetic, Interpretable Tasks
  ☆10Updated 10 months ago
• Sanaelotfi / Bayesian_model_comparison
  Supporing code for the paper "Bayesian Model Selection, the Marginal Likelihood, and Generalization".
  ☆35Updated 2 years ago