Alternatives and similar repositories for Awesome-Optimizer

Users that are interested in Awesome-Optimizer are comparing it to the libraries listed below

• tensorly / torch
  TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch
  ☆77Updated 11 months ago
• gpauloski / kfac-pytorch
  Distributed K-FAC preconditioner for PyTorch
  ☆87Updated last week
• kwignb / NeuralTangentKernel-Papers
  Neural Tangent Kernel Papers
  ☆112Updated 4 months ago
• pvti / Awesome-Tensor-Decomposition
  😎 A curated list of tensor decomposition resources for model compression.
  ☆68Updated 2 weeks ago
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆31Updated 7 months ago
• jongharyu / neural-svd
  ☆16Updated 8 months ago
• shikaiqiu / compute-better-spent
  ☆53Updated 8 months ago
• locuslab / edge-of-stability
  ☆67Updated 6 months ago
• epfml / optML-pku
  summer school materials
  ☆44Updated last year
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆59Updated 2 months ago
• AndPotap / einsum-search
  ☆32Updated 8 months ago
• facebookresearch / LANCER
  Repo for the paper "Landscape Surrogate Learning Decision Losses for Mathematical Optimization Under Partial Information"
  ☆36Updated last year
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆61Updated last year
• topal-team / rockmate
  ☆36Updated 5 months ago
• phlippe / jax_trainer
  Lightning-like training API for JAX with Flax
  ☆38Updated 5 months ago
• orobix / fwdgrad
  Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch
  ☆109Updated last year
• xu-ji / information-bottleneck
  Deep Learning & Information Bottleneck
  ☆60Updated last year
• sail-sg / win
  ☆9Updated last year
• KellerJordan / top-sgd
  Optimization algorithm which fits a ResNet to CIFAR-10 5x faster than SGD / Adam (with terrible generalization)
  ☆14Updated last year
• facebookresearch / projUNN
  Fast training of unitary deep network layers from low-rank updates
  ☆28Updated 2 years ago
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆66Updated 8 months ago
• joneswack / dp-rfs
  This repository contains PyTorch implementations of various random feature maps for dot product kernels.
  ☆21Updated 10 months ago
• SamsungLabs / BayesDLL
  ☆147Updated last year
• alisiahkoohi / Langevin-dynamics
  Sampling with gradient-based Markov Chain Monte Carlo approaches
  ☆101Updated last year
• JunLi-Galios / Optimization-on-Stiefel-Manifold-via-Cayley-Transform
  Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform
  ☆40Updated 6 years ago
• konstmish / opt_methods
  Benchmarking optimization methods on convex problems.
  ☆32Updated last year
• diffprog / code
  Code for the book "The Elements of Differentiable Programming".
  ☆86Updated 2 months ago
• YinTat / optimizationbook
  ☆139Updated 2 weeks ago
• nikhilvyas / SOAP
  ☆185Updated 6 months ago
• f-dangel / curvlinops
  PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)
  ☆39Updated last month