Alternatives and similar repositories for optimizer:

Users that are interested in optimizer are comparing it to the libraries listed below

• shikaiqiu / compute-better-spent
  ☆50Updated 3 months ago
• tml-epfl / sharpness-vs-generalization
  A modern look at the relationship between sharpness and generalization [ICML 2023]
  ☆43Updated last year
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆36Updated 2 years ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆57Updated last year
• locuslab / edge-of-stability
  ☆63Updated last month
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆59Updated 4 months ago
• AndyShih12 / LongHorizonTemperatureScaling
  PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023
  ☆20Updated last year
• aks2203 / deep-thinking
  A centralized place for deep thinking code and experiments
  ☆79Updated last year
• xu-ji / information-bottleneck
  Deep Learning & Information Bottleneck
  ☆53Updated last year
• AllanYangZhou / universal_neural_functional
  ☆48Updated 11 months ago
• bilal-chughtai / rep-theory-mech-interp
  ☆26Updated last year
• aks2203 / easy-to-hard-data
  Pytorch Datasets for Easy-To-Hard
  ☆27Updated 2 weeks ago
• pilancilab / Riemannian_Preconditioned_LoRA
  source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"
  ☆21Updated 7 months ago
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆28Updated last year
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆79Updated last year
• oripress / EntropyEnigma
  Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"
  ☆47Updated 8 months ago
• JonasGeiping / dataaugs
  ☆17Updated 2 years ago
• gregorbachmann / scaling_mlps
  ☆51Updated 7 months ago
• facebookresearch / ModelRatatouille
  Recycling diverse models
  ☆44Updated 2 years ago
• tml-epfl / understanding-sam
  Towards Understanding Sharpness-Aware Minimization [ICML 2022]
  ☆35Updated 2 years ago
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆70Updated 2 years ago
• tml-epfl / sam-low-rank-features
  Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]
  ☆25Updated last year
• MadryLab / modeldiff
  ModelDiff: A Framework for Comparing Learning Algorithms
  ☆54Updated last year
• rtaori / data_feedback
  Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"
  ☆15Updated 2 years ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆67Updated 2 months ago
• pomonam / jax-influence
  A simple Jax implementation of influence functions.
  ☆16Updated 9 months ago
• ppope / dimensions
  Code for "The Intrinsic Dimension of Images and Its Impact on Learning" - ICLR 2021 Spotlight https://openreview.net/forum?id=XJk19XzGq2J
  ☆65Updated 9 months ago
• AndPotap / einsum-search
  ☆29Updated 3 months ago
• tml-epfl / sgd-sparse-features
  SGD with large step sizes learns sparse features [ICML 2023]
  ☆32Updated last year
• berlino / seq_icl
  ☆51Updated 8 months ago