Alternatives and similar repositories for Awesome-Optimizer:

Users that are interested in Awesome-Optimizer are comparing it to the libraries listed below

• gpauloski / kfac-pytorch
  Distributed K-FAC Preconditioner for PyTorch
  ☆85Updated this week
• tensorly / torch
  TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch
  ☆77Updated 9 months ago
• konstmish / opt_methods
  Benchmarking optimization methods on convex problems.
  ☆31Updated last year
• locuslab / edge-of-stability
  ☆65Updated 3 months ago
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆60Updated last year
• n-gao / pytorch-kfac
  Pytorch implementation of KFAC - this is a port of https://github.com/tensorflow/kfac/
  ☆23Updated 9 months ago
• phlippe / jax_trainer
  Lightning-like training API for JAX with Flax
  ☆38Updated 3 months ago
• epfml / optML-pku
  summer school materials
  ☆44Updated last year
• kwignb / NeuralTangentKernel-Papers
  Neural Tangent Kernel Papers
  ☆106Updated 2 months ago
• nikhilvyas / SOAP
  ☆171Updated 3 months ago
• orobix / fwdgrad
  Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch
  ☆108Updated last year
• sail-sg / stde
  Official implementation of Stochastic Taylor Derivative Estimator (STDE) NeurIPS2024
  ☆102Updated 4 months ago
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆53Updated 2 weeks ago
• logancyang / loss-landscape-anim
  Create animations for the optimization trajectory of neural nets
  ☆147Updated last year
• gortizji / linearized-networks
  Source code of "What can linearized neural networks actually say about generalization?
  ☆20Updated 3 years ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆170Updated 3 months ago
• topal-team / rockmate
  ☆36Updated 3 months ago
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆78Updated 10 months ago
• bremen79 / parameterfree
  Parameter-Free Optimizers for Pytorch
  ☆122Updated 11 months ago
• verbiiyo / rigl-torch
  Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.
  ☆56Updated 3 years ago
• shikaiqiu / compute-better-spent
  ☆52Updated 5 months ago
• spcl / sten
  Sparsity support for PyTorch
  ☆35Updated this week
• f-dangel / curvlinops
  PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)
  ☆34Updated 3 weeks ago
• jongharyu / neural-svd
  ☆16Updated 6 months ago
• facebookresearch / LAWT
  Code for papers Linear Algebra with Transformers (TMLR) and What is my Math Transformer Doing? (AI for Maths Workshop, Neurips 2022)
  ☆67Updated 7 months ago
• bobby-he / Neural_Tangent_Kernel
  ☆66Updated 6 years ago
• joneswack / dp-rfs
  This repository contains PyTorch implementations of various random feature maps for dot product kernels.
  ☆19Updated 8 months ago
• wiseodd / pub-ready-plots
  Agustinus' very opiniated publication-ready plotting library
  ☆62Updated last month
• xu-ji / information-bottleneck
  Deep Learning & Information Bottleneck
  ☆58Updated last year
• ZQZCalin / trainit
  ☆11Updated this week