Alternatives and similar repositories for top-sgd:

Users that are interested in top-sgd are comparing it to the libraries listed below

• shikaiqiu / compute-better-spent
  ☆52Updated 5 months ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆171Updated this week
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆36Updated 2 years ago
• Artur-Galstyan / statedict2pytree
  ☆42Updated this week
• google-deepmind / dks
  Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…
  ☆68Updated last week
• evanatyourservice / psgd_jax
  Implementation of PSGD optimizer in JAX
  ☆30Updated 2 months ago
• AakashKumarNain / mistral_jax
  This is a port of Mistral-7B model in JAX
  ☆32Updated 8 months ago
• AhmedImtiazPrio / grok-adversarial
  Deep Networks Grok All the Time and Here is Why
  ☆33Updated 10 months ago
• lucidrains / GAF-microbatch-pytorch
  Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch
  ☆23Updated 2 months ago
• ml-gde / jflux
  JAX Implementation of Black Forest Labs' Flux.1 family of models
  ☆30Updated 5 months ago
• cloneofsimo / zeroshampoo
  ☆33Updated 6 months ago
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆45Updated 2 years ago
• dylandoblar / noether-networks
  Meta-learning inductive biases in the form of useful conserved quantities.
  ☆37Updated 2 years ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆122Updated last year
• google-deepmind / spectral_ssm
  ☆31Updated 11 months ago
• matthias-wright / jax-fid
  FID computation in Jax/Flax.
  ☆27Updated 8 months ago
• apple / ml-ademamix
  ☆59Updated 4 months ago
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆29Updated last year
• crowsonkb / dice-mc
  DiCE: The Infinitely Differentiable Monte-Carlo Estimator
  ☆31Updated last year
• Z-T-WANG / LaProp-Optimizer
  Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"
  ☆28Updated 4 years ago
• AllanYangZhou / universal_neural_functional
  ☆49Updated last year
• vvvm23 / mezo-jax
  JAX implementation of "Fine-Tuning Language Models with Just Forward Passes"
  ☆19Updated last year
• lucidrains / frame-averaging-pytorch
  Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network
  ☆49Updated 8 months ago
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• riverstone496 / awesome-second-order-optimization
  ☆25Updated last year
• srush / Tensor-Puzzles-Penzai
  ☆20Updated 11 months ago
• phlippe / jax_trainer
  Lightning-like training API for JAX with Flax
  ☆38Updated 3 months ago
• aks2203 / easy-to-hard
  Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"
  ☆60Updated 3 years ago
• google-deepmind / eigengame
  Open source code for EigenGame.
  ☆30Updated last year
• kvfrans / jax-flow
  Flow-matching algorithms in JAX
  ☆86Updated 7 months ago