Alternatives and similar repositories for Awesome-Optimizer

Users that are interested in Awesome-Optimizer are comparing it to the libraries listed below

• tensorly / torch
  TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch
  ☆79Updated last year
• gpauloski / kfac-pytorch
  Distributed K-FAC preconditioner for PyTorch
  ☆87Updated this week
• orobix / fwdgrad
  Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch
  ☆110Updated 2 years ago
• kwignb / NeuralTangentKernel-Papers
  Neural Tangent Kernel Papers
  ☆114Updated 5 months ago
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆63Updated last year
• KellerJordan / top-sgd
  Optimization algorithm which fits a ResNet to CIFAR-10 5x faster than SGD / Adam (with terrible generalization)
  ☆14Updated last year
• f-dangel / singd
  [ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)
  ☆22Updated 7 months ago
• alisiahkoohi / Langevin-dynamics
  Sampling with gradient-based Markov Chain Monte Carlo approaches
  ☆103Updated last year
• shikaiqiu / compute-better-spent
  ☆53Updated 8 months ago
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆66Updated 9 months ago
• locuslab / edge-of-stability
  ☆68Updated 6 months ago
• pvti / Awesome-Tensor-Decomposition
  😎 A curated list of tensor decomposition resources for model compression.
  ☆69Updated this week
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆59Updated 3 months ago
• JunLi-Galios / Optimization-on-Stiefel-Manifold-via-Cayley-Transform
  Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform
  ☆41Updated 6 years ago
• jongharyu / neural-svd
  ☆16Updated 9 months ago
• JoelNiklaus / loss_landscape
  Code for visualizing the loss landscape of neural nets
  ☆10Updated 4 years ago
• facebookresearch / LAWT
  Code for papers Linear Algebra with Transformers (TMLR) and What is my Math Transformer Doing? (AI for Maths Workshop, Neurips 2022)
  ☆68Updated 10 months ago
• phlippe / jax_trainer
  Lightning-like training API for JAX with Flax
  ☆41Updated 6 months ago
• diffprog / code
  Code for the book "The Elements of Differentiable Programming".
  ☆88Updated this week
• lzhangbv / eva
  [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation
  ☆12Updated last year
• konstmish / opt_methods
  Benchmarking optimization methods on convex problems.
  ☆32Updated last year
• AndPotap / einsum-search
  ☆32Updated 8 months ago
• google-research / jaxpruner
  ☆229Updated 4 months ago
• facebookresearch / LANCER
  Repo for the paper "Landscape Surrogate Learning Decision Losses for Mathematical Optimization Under Partial Information"
  ☆36Updated last year
• joneswack / dp-rfs
  This repository contains PyTorch implementations of various random feature maps for dot product kernels.
  ☆21Updated 11 months ago
• spcl / sten
  Sparsity support for PyTorch
  ☆35Updated 3 months ago
• srush / mamba-primer
  ☆37Updated last year
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆37Updated 2 years ago
• xu-ji / information-bottleneck
  Deep Learning & Information Bottleneck
  ☆60Updated last year
• sail-sg / win
  ☆9Updated 2 years ago