Alternatives and similar repositories for top-sgd

Users that are interested in top-sgd are comparing it to the libraries listed below

• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆36Updated 2 years ago
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆37Updated 2 years ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆175Updated this week
• shikaiqiu / compute-better-spent
  ☆53Updated 8 months ago
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆45Updated 2 years ago
• facebookresearch / w2ot
  Euclidean Wasserstein-2 optimal transportation
  ☆47Updated last year
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆66Updated 8 months ago
• facebookresearch / projUNN
  Fast training of unitary deep network layers from low-rank updates
  ☆28Updated 2 years ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆124Updated last year
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆30Updated last year
• gortizji / linearized-networks
  Source code of "What can linearized neural networks actually say about generalization?
  ☆20Updated 3 years ago
• NVlabs / Forecasting-Model-Search
  A system for automating selection and optimization of pre-trained models from the TAO Model Zoo
  ☆25Updated 11 months ago
• sjunhongshen / DASH
  ☆22Updated 2 years ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆81Updated last year
• AhmedImtiazPrio / grok-adversarial
  Deep Networks Grok All the Time and Here is Why
  ☆36Updated last year
• y0ast / pytorch-snippets
  Collection of snippets for PyTorch users
  ☆25Updated 3 years ago
• lucidrains / GAF-microbatch-pytorch
  Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch
  ☆25Updated 4 months ago
• rahul13ramesh / compositional_capabilities
  Compositional Capabilities of Autoregressive Transformers: A Study on Synthetic, Interpretable Tasks
  ☆10Updated 11 months ago
• AndPotap / einsum-search
  ☆32Updated 8 months ago
• srush / mamba-scans
  Blog post
  ☆17Updated last year
• gregorbachmann / scaling_mlps
  ☆51Updated 11 months ago
• Sanaelotfi / Bayesian_model_comparison
  Supporing code for the paper "Bayesian Model Selection, the Marginal Likelihood, and Generalization".
  ☆35Updated 2 years ago
• f-dangel / vivit
  [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…
  ☆17Updated last year
• activatedgeek / tight-pac-bayes
  Code for PAC-Bayes Compression Bounds So Tight That They Can Explain Generalization, NeurIPS 2022
  ☆15Updated 2 years ago
• locuslab / edge-of-stability
  ☆67Updated 5 months ago
• lucidrains / frame-averaging-pytorch
  Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network
  ☆50Updated 10 months ago
• vvvm23 / mezo-jax
  JAX implementation of "Fine-Tuning Language Models with Just Forward Passes"
  ☆19Updated last year
• necludov / action-matching
  Implementation of Action Matching for the Schrödinger equation
  ☆24Updated last year
• necludov / wl-mechanics
  ☆32Updated last year
• google-deepmind / dks
  Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…
  ☆70Updated last week