zoq / Awesome-OptimizerLinks
Collect optimizer related papers, data, repositories
☆98Updated last year
Alternatives and similar repositories for Awesome-Optimizer
Users that are interested in Awesome-Optimizer are comparing it to the libraries listed below
Sorting:
- Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch☆114Updated 2 years ago
- Distributed K-FAC preconditioner for PyTorch☆93Updated this week
- DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule☆63Updated 2 years ago
- TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch☆81Updated last year
- Parameter-Free Optimizers for Pytorch☆130Updated last year
- Create animations for the optimization trajectory of neural nets☆161Updated last year
- Neural Tangent Kernel Papers☆120Updated 11 months ago
- Sampling with gradient-based Markov Chain Monte Carlo approaches☆108Updated last year
- ☆73Updated last year
- Code for papers Linear Algebra with Transformers (TMLR) and What is my Math Transformer Doing? (AI for Maths Workshop, Neurips 2022)☆76Updated last year
- ☆227Updated last year
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆191Updated last year
- ☆148Updated 6 months ago
- This repository contains PyTorch implementations of various random feature maps for dot product kernels.☆22Updated last year
- Pytorch implementation of KFAC - this is a port of https://github.com/tensorflow/kfac/☆30Updated last year
- summer school materials☆46Updated 2 years ago
- Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]☆69Updated last year
- About A collection of AWESOME things about information geometry Topics☆172Updated last year
- Pytorch code for experiments on Linear Transformers☆24Updated last year
- Agustinus' very opiniated publication-ready plotting library☆69Updated 7 months ago
- [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…☆17Updated 2 years ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆188Updated last week
- optimizer & lr scheduler & loss function collections in PyTorch☆376Updated last week
- A general-purpose, deep learning-first library for constrained optimization in PyTorch☆146Updated 3 weeks ago
- Omnigrok: Grokking Beyond Algorithmic Data☆62Updated 2 years ago
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆382Updated last week
- ☆62Updated last year
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆127Updated 2 years ago
- Implementations of various linear RNN layers using pytorch and triton☆54Updated 2 years ago
- Lightning-like training API for JAX with Flax☆44Updated last year