Alternatives and similar repositories for optimizer:

Users that are interested in optimizer are comparing it to the libraries listed below

• tml-epfl / sharpness-vs-generalization
  A modern look at the relationship between sharpness and generalization [ICML 2023]
  ☆43Updated last year
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆36Updated 2 years ago
• shikaiqiu / compute-better-spent
  ☆51Updated 4 months ago
• aks2203 / deep-thinking
  A centralized place for deep thinking code and experiments
  ☆81Updated last year
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆58Updated last year
• pilancilab / Riemannian_Preconditioned_LoRA
  source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"
  ☆21Updated 7 months ago
• locuslab / edge-of-stability
  ☆63Updated 2 months ago
• nick11roberts / XD
  ☆11Updated 2 years ago
• js-d / sim_metric
  ☆35Updated last year
• ejmichaud / grokking-squared
  ☆24Updated 2 years ago
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆60Updated 4 months ago
• ppope / dimensions
  Code for "The Intrinsic Dimension of Images and Its Impact on Learning" - ICLR 2021 Spotlight https://openreview.net/forum?id=XJk19XzGq2J
  ☆65Updated 9 months ago
• MadryLab / modeldiff
  ModelDiff: A Framework for Comparing Learning Algorithms
  ☆55Updated last year
• gortizji / linearized-networks
  Source code of "What can linearized neural networks actually say about generalization?
  ☆20Updated 3 years ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆79Updated last year
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆28Updated last year
• tml-epfl / sgd-sparse-features
  SGD with large step sizes learns sparse features [ICML 2023]
  ☆32Updated last year
• MadryLab / failure-directions
  Distilling Model Failures as Directions in Latent Space
  ☆46Updated 2 years ago
• aks2203 / easy-to-hard-data
  Pytorch Datasets for Easy-To-Hard
  ☆27Updated last month
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆44Updated 2 years ago
• AllanYangZhou / universal_neural_functional
  ☆49Updated last year
• KellerJordan / REPAIR
  Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair
  ☆46Updated last year
• facebookresearch / ModelRatatouille
  Recycling diverse models
  ☆44Updated 2 years ago
• bhoov / energy-transformer-jax
  The Energy Transformer block, in JAX
  ☆55Updated last year
• YannDubs / Invariant-Self-Supervised-Learning
  Pytorch code for "Improving Self-Supervised Learning by Characterizing Idealized Representations"
  ☆40Updated 2 years ago
• JonasGeiping / dataaugs
  ☆17Updated 2 years ago
• google-research / jax-influence
  ☆60Updated 3 years ago
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆59Updated 3 years ago
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆58Updated last year