Alternatives and similar repositories for Awesome-Optimizer

Users that are interested in Awesome-Optimizer are comparing it to the libraries listed below

• orobix / fwdgrad
  Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch
  ☆111Updated 2 years ago
• gpauloski / kfac-pytorch
  Distributed K-FAC preconditioner for PyTorch
  ☆89Updated last week
• tensorly / torch
  TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch
  ☆80Updated last year
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆63Updated 2 years ago
• kwignb / NeuralTangentKernel-Papers
  Neural Tangent Kernel Papers
  ☆115Updated 7 months ago
• YinTat / optimizationbook
  ☆142Updated 2 months ago
• locuslab / edge-of-stability
  ☆70Updated 8 months ago
• logancyang / loss-landscape-anim
  Create animations for the optimization trajectory of neural nets
  ☆158Updated last year
• sail-sg / stde
  Official implementation of Stochastic Taylor Derivative Estimator (STDE) NeurIPS2024
  ☆117Updated 9 months ago
• KindXiaoming / Omnigrok
  Omnigrok: Grokking Beyond Algorithmic Data
  ☆61Updated 2 years ago
• nikhilvyas / SOAP
  ☆207Updated 8 months ago
• facebookresearch / LAWT
  Code for papers Linear Algebra with Transformers (TMLR) and What is my Math Transformer Doing? (AI for Maths Workshop, Neurips 2022)
  ☆75Updated last year
• alisiahkoohi / Langevin-dynamics
  Sampling with gradient-based Markov Chain Monte Carlo approaches
  ☆108Updated last year
• facebookresearch / LANCER
  Repo for the paper "Landscape Surrogate Learning Decision Losses for Mathematical Optimization Under Partial Information"
  ☆36Updated 2 years ago
• bremen79 / parameterfree
  Parameter-Free Optimizers for Pytorch
  ☆130Updated last year
• MinghuiChen43 / awesome-deep-phenomena
  A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...
  ☆358Updated last month
• google-research / jaxpruner
  ☆233Updated 6 months ago
• kozistr / pytorch_optimizer
  optimizer & lr scheduler & loss function collections in PyTorch
  ☆344Updated last week
• pvti / Awesome-Tensor-Decomposition
  😎 A curated list of tensor decomposition resources for model compression.
  ☆79Updated last week
• chengxiang / LinearTransformer
  Pytorch code for experiments on Linear Transformers
  ☆21Updated last year
• cooper-org / cooper
  A general-purpose, deep learning-first library for constrained optimization in PyTorch
  ☆137Updated 2 months ago
• phlippe / jax_trainer
  Lightning-like training API for JAX with Flax
  ☆42Updated 8 months ago
• wiseodd / pub-ready-plots
  Agustinus' very opiniated publication-ready plotting library
  ☆69Updated 3 months ago
• LIONS-EPFL / scion
  ☆37Updated 2 weeks ago
• cbg-ethz / bmi
  Mutual information estimators and benchmark
  ☆51Updated 7 months ago
• jongharyu / neural-svd
  Official PyTorch implementation of NeuralSVD (ICML 2024)
  ☆20Updated 11 months ago
• OPTML-Group / DeepZero
  [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…
  ☆66Updated 10 months ago
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆79Updated last year
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆179Updated this week
• epfml / optML-pku
  summer school materials
  ☆44Updated 2 years ago