Alternatives and similar repositories for Awesome-Optimizer:

Users that are interested in Awesome-Optimizer are comparing it to the libraries listed below

• gpauloski / kfac-pytorch
  Distributed K-FAC Preconditioner for PyTorch
  ☆85Updated this week
• locuslab / edge-of-stability
  ☆65Updated 3 months ago
• kwignb / NeuralTangentKernel-Papers
  Neural Tangent Kernel Papers
  ☆106Updated 2 months ago
• epfml / optML-pku
  summer school materials
  ☆44Updated last year
• topal-team / rockmate
  ☆35Updated 3 months ago
• orobix / fwdgrad
  Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch
  ☆108Updated last year
• alisiahkoohi / Langevin-dynamics
  Sampling with gradient-based Markov Chain Monte Carlo approaches
  ☆97Updated 10 months ago
• phlippe / jax_trainer
  Lightning-like training API for JAX with Flax
  ☆38Updated 3 months ago
• tensorly / torch
  TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch
  ☆77Updated 9 months ago
• bremen79 / parameterfree
  Parameter-Free Optimizers for Pytorch
  ☆121Updated 10 months ago
• nikhilvyas / SOAP
  ☆164Updated 3 months ago
• spcl / sten
  Sparsity support for PyTorch
  ☆35Updated last month
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆59Updated last year
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆51Updated this week
• YinTat / optimizationbook
  ☆134Updated this week
• konstmish / opt_methods
  Benchmarking optimization methods on convex problems.
  ☆31Updated last year
• jongharyu / neural-svd
  ☆16Updated 5 months ago
• shikaiqiu / compute-better-spent
  ☆52Updated 5 months ago
• NicolasZucchet / minimal-LRU
  Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)
  ☆52Updated 4 months ago
• facebookresearch / LANCER
  Repo for the paper "Landscape Surrogate Learning Decision Losses for Mathematical Optimization Under Partial Information"
  ☆36Updated last year
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆51Updated last month
• pilancilab / convex_nn
  ☆13Updated 3 years ago
• gortizji / linearized-networks
  Source code of "What can linearized neural networks actually say about generalization?
  ☆20Updated 3 years ago
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆61Updated 5 months ago
• linusericsson / einspace
  Official code for our NeurIPS 2024 paper "einspace: Searching for Neural Architectures from Fundamental Operations"
  ☆27Updated 4 months ago
• AndPotap / einsum-search
  ☆30Updated 5 months ago
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆30Updated 4 months ago
• kxh001 / ITdiffusion
  Information-Theoretic Diffusion: A brand new diffusion model / density estimator based on information theory.
  ☆32Updated 7 months ago
• xu-ji / information-bottleneck
  Deep Learning & Information Bottleneck
  ☆58Updated last year
• lzhangbv / eva
  [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation
  ☆12Updated last year